-- Logs begin at Thu 2022-05-19 20:37:38 UTC, end at Thu 2022-05-19 22:02:21 UTC. -- May 19 21:23:44.961166 dv-cinder-835635-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 21:23:44.968707 dv-cinder-835635-2-smb devstack@keystone.service[80336]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 21:23:44 2022] *** May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: nodename: dv-cinder-835635-2-smb May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: machine: x86_64 May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: clock source: unix May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: pcre jit disabled May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: detected number of CPU cores: 4 May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: current working directory: / May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: detected binary path: /usr/bin/uwsgi-core May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: your processes number limit is 47680 May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: your memory page size is 4096 bytes May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: detected max file descriptor number: 2048 May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: lock engine: pthread robust mutexes May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: thunder lock: enabled May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 21:23:44.973061 dv-cinder-835635-2-smb devstack@keystone.service[80336]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 21:23:45.017127 dv-cinder-835635-2-smb devstack@keystone.service[80336]: Python main interpreter initialized at 0x55b3e3a2b9c0 May 19 21:23:45.017127 dv-cinder-835635-2-smb devstack@keystone.service[80336]: python threads support enabled May 19 21:23:45.017127 dv-cinder-835635-2-smb devstack@keystone.service[80336]: your server socket listen backlog is limited to 100 connections May 19 21:23:45.017127 dv-cinder-835635-2-smb devstack@keystone.service[80336]: your mercy for graceful operations on workers is 90 seconds May 19 21:23:45.017489 dv-cinder-835635-2-smb devstack@keystone.service[80336]: mapped 403077 bytes (393 KB) for 2 cores May 19 21:23:45.017563 dv-cinder-835635-2-smb devstack@keystone.service[80336]: *** Operational MODE: preforking *** May 19 21:23:45.017844 dv-cinder-835635-2-smb devstack@keystone.service[80336]: *** uWSGI is running in multiple interpreter mode *** May 19 21:23:45.017844 dv-cinder-835635-2-smb devstack@keystone.service[80336]: spawned uWSGI master process (pid: 80336) May 19 21:23:45.018057 dv-cinder-835635-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 21:23:45.019158 dv-cinder-835635-2-smb devstack@keystone.service[80336]: spawned uWSGI worker 1 (pid: 80350, cores: 1) May 19 21:23:45.019158 dv-cinder-835635-2-smb devstack@keystone.service[80336]: spawned uWSGI worker 2 (pid: 80351, cores: 1) May 19 21:23:45.019158 dv-cinder-835635-2-smb devstack@keystone.service[80336]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 21:23:50.667474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:23:50.667474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: from cryptography.utils import int_from_bytes May 19 21:23:50.668290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:23:50.668290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: from cryptography.utils import int_from_bytes May 19 21:23:50.668828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:23:50.668828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: from cryptography.utils import int_from_bytes May 19 21:23:50.668946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:23:50.668946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: from cryptography.utils import int_from_bytes May 19 21:23:50.717840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:23:50.718029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:23:50.718229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] command line args: [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:23:50.718511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:23:50.718603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:23:50.718680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ================================================================================ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:23:50.718755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:23:50.718888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] command line args: [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:23:50.718972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] admin_token = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.719149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config_dir = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.719227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:23:50.719334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.719413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ================================================================================ {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:23:50.719514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config_source = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.719597 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] admin_token = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.719675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] debug = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.719818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] config_dir = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.719894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.720134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.720198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] config_source = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.720258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.720394 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] debug = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.720503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.720599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_config_append = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.721924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_dir = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] list_limit = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] log_config_append = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] log_dir = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.722962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] log_file = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.723940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.724942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.725047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.725123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.725282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.725406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.725516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.725602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.725765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] publish_errors = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.726980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] publish_errors = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] standard_threads = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.727990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_journal = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] standard_threads = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_json = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_stderr = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_syslog = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.728972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.729058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.729138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] use_journal = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.729285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.729367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] use_json = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.729476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] use_stderr = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.729552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.729653 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] use_syslog = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.729764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.729887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:23:50.730003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.730147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.730271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.730424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.730507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.730687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.730762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.730930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731901 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.731983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.732939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.733910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.734916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.735994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.736077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.736842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.736929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737167 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.737888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.738859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.739993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.740940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.741866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.742976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.743979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.744923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745154 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.745833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.746975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.747995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.748925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.749855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.750998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.751937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752899 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.752976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753454 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.753933 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.external = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.754953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.password = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] auth.external = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.token = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.755932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] auth.password = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.756919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] auth.token = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.757942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758454 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.758915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] credential.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.759882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.760895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.761839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.762981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.763936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.764978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.765880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.766038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.766115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.766311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.782988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.783149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.783732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.783818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.783897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.783969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.784957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.785931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.786940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787560 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787635 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.787985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788899 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.788969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.789945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.790963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791668 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.791927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.792981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.793966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794181 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.794974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] role.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.795976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] role.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.796935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.797905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.798933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799496 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.799996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.800930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.801944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.802989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.connection = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.803951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.804944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.805956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.806033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.806104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.806173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.806258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:23:50.806319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:23:50.806388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:23:50.836336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.836563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.836792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.837481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.837718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.837949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.847227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.847428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.875282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.875449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.875551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.875682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.928598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.929064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.980338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.980577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.980793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:50.981031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.045948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.046177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.046381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.046472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.046615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.046701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.046837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.046921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.047052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.047136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.047264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.047479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.070399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.070594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.070682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.070827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.070910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.071914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.083613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.084011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.097083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.097316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.097544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.097770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.097986 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.098203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.098452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.098584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.098823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.099053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.099282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.099506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.099726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.099946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:23:51.115632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.115843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:23:51.115975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.116155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:23:51.116285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.116414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:23:51.116540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.116668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.116803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:23:51.116937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.117065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.117192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.117330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.117464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.117600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.117733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.129217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.129496 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.129764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.130046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.130686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.130966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.131237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.131519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.138174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.139675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.141478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.141761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.142048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.142533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.143307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.143576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.143706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.143835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.143974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.144111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.144239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.144366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.144493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.144620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.144782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.144919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.145054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.145305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.145579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.145847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.146119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.146411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.171328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.172706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.172933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.173218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.174393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.174675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.178560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.178949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.179125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.179921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.180203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.180491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.186443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.186732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.187773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.188056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.191874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.192162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.192693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.192977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.193254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.193437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.193522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.193727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.193819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.194009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.194093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.194313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.194588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.194862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.195132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.195398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.212650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.212933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.214025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.214334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.217458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.218887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.221606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.221901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.223075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.223371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.226883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.228345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.230465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.231961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.234222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.234538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.234824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.235105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.235391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.235672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.235755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.236009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.236909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.237226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.237536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.237848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.255207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.255565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.255838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.256115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.256738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.257114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.257385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.257652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.264045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.265634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.265775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.266054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.267356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.267675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.269146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.269429 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.269726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.270010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.270313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.270707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.270997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.271291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.271586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.271861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.284247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.284533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.284818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.285115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.285401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.285678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.285763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.285959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.286059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.286290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.286577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.286860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.287136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.287413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.304717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.305974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.308011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.309231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.311357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.312554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.312956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.314140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.314665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.314956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.315254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.315862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.316149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.316429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.322929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.324077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.324546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.325693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.327810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.328104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.328391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.328672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.328923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.329212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.329498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.329778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.337976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.338335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.338665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.339018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.339307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.339587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.347114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.347398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.347681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.347970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.348072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:23:51.348247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.348339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.348524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.348613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.348797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.348895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.349968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.350138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.350258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.350436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.350525 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.350706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.350794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.350962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.351229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.351492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:23:51.389852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3e3a2b9c0 pid: 80350 (default app) May 19 21:23:51.390481 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3e3a2b9c0 pid: 80351 (default app) May 19 21:23:51.393305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38b63a-8c78-432b-b366-e0f6f42bba4d None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:23:51.393601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38b63a-8c78-432b-b366-e0f6f42bba4d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:23:51.393885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38b63a-8c78-432b-b366-e0f6f42bba4d None None] PATH_INFO: `/v3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:23:51.398089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Thu May 19 21:23:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:00.505860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4f2e-bc11-4ed7-92ed-12be49145e51 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:00.506428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4f2e-bc11-4ed7-92ed-12be49145e51 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:00.506428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4f2e-bc11-4ed7-92ed-12be49145e51 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:00.510733 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:00.516048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:00.516479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:00.516582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:00.585191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: INFO dbcounter [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] Registered counter for database keystone May 19 21:24:00.606850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG oslo_db.sqlalchemy.engines [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:24:00.613210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writer thread running {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:24:00.787183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG passlib.handlers.bcrypt [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80350) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 21:24:00.787592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG passlib.handlers.bcrypt [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80350) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 21:24:00.842962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:00.844578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:00.966780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 21:24:01.143829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4f2e-bc11-4ed7-92ed-12be49145e51 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:01.211959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: INFO dbcounter [None req-558f4f2e-bc11-4ed7-92ed-12be49145e51 None None] Registered counter for database keystone May 19 21:24:01.231851 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG oslo_db.sqlalchemy.engines [None req-558f4f2e-bc11-4ed7-92ed-12be49145e51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:24:01.238058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writer thread running {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:24:01.356686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4f2e-bc11-4ed7-92ed-12be49145e51 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:01.360986 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cbfab-c9f6-49df-9bd9-9177ef129c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:01.361649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbfab-c9f6-49df-9bd9-9177ef129c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:01.361938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbfab-c9f6-49df-9bd9-9177ef129c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:01.362233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbfab-c9f6-49df-9bd9-9177ef129c34 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:01.370389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cbfab-c9f6-49df-9bd9-9177ef129c34 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:01.425388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb5cbfab-c9f6-49df-9bd9-9177ef129c34 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 21:24:01.425681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cbfab-c9f6-49df-9bd9-9177ef129c34 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:01.435686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Thu May 19 21:24:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:24:01.442563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:01.457469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a12e0e-8668-4bbd-b5a0-cd525e5b6564 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:01.461858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21788c7a-3e03-4f9b-9c9b-6d3b0dda1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:01.462992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21788c7a-3e03-4f9b-9c9b-6d3b0dda1504 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:01.463286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21788c7a-3e03-4f9b-9c9b-6d3b0dda1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:01.463563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21788c7a-3e03-4f9b-9c9b-6d3b0dda1504 admin admin] PATH_INFO: `/v3/projects/a3d3385220604fe5b83ffe6c82f91b54` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:01.465112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21788c7a-3e03-4f9b-9c9b-6d3b0dda1504 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3d3385220604fe5b83ffe6c82f91b54)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:01.622230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING keystone.common.rbac_enforcer.enforcer [None req-21788c7a-3e03-4f9b-9c9b-6d3b0dda1504 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 21:24:01.622885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21788c7a-3e03-4f9b-9c9b-6d3b0dda1504 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:01.627761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Thu May 19 21:24:01 2022] GET /identity/v3/projects/a3d3385220604fe5b83ffe6c82f91b54 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:03.817303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecedf9-4563-4d4a-a040-84287a78a2a4 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:03.817893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecedf9-4563-4d4a-a040-84287a78a2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:03.817893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecedf9-4563-4d4a-a040-84287a78a2a4 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:03.822028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:03.827416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a0712-e983-4852-871d-4182cd49a756 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:03.827824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a0712-e983-4852-871d-4182cd49a756 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:03.827982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a0712-e983-4852-871d-4182cd49a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:03.847032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-653a0712-e983-4852-871d-4182cd49a756 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:03.848541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-653a0712-e983-4852-871d-4182cd49a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:03.856352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 21:24:03.878987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecedf9-4563-4d4a-a040-84287a78a2a4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:03.890849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecedf9-4563-4d4a-a040-84287a78a2a4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:03.895079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac978b-06cb-4be7-bd93-92306d3dfcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:03.895703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac978b-06cb-4be7-bd93-92306d3dfcde admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:03.895992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac978b-06cb-4be7-bd93-92306d3dfcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:03.896274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac978b-06cb-4be7-bd93-92306d3dfcde admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:03.903878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac978b-06cb-4be7-bd93-92306d3dfcde admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:03.905646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac978b-06cb-4be7-bd93-92306d3dfcde admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:03.914832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Thu May 19 21:24:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:24:03.920072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a0712-e983-4852-871d-4182cd49a756 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:03.929525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a0712-e983-4852-871d-4182cd49a756 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:03.933856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06981954-2305-488d-822a-11c5c8d1e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:03.934748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981954-2305-488d-822a-11c5c8d1e366 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:03.935038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981954-2305-488d-822a-11c5c8d1e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:03.935319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981954-2305-488d-822a-11c5c8d1e366 admin admin] PATH_INFO: `/v3/users/21d9725cafcc4283be987ee60ded1556` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:03.936713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06981954-2305-488d-822a-11c5c8d1e366 admin admin] RBAC: Authorizing `identity:get_user(user_id=21d9725cafcc4283be987ee60ded1556)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:03.938566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06981954-2305-488d-822a-11c5c8d1e366 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:03.940121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Thu May 19 21:24:03 2022] GET /identity/v3/users/21d9725cafcc4283be987ee60ded1556 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:06.240017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc49a4-99c9-42d0-86f1-f44ec2500472 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.240550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc49a4-99c9-42d0-86f1-f44ec2500472 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.240714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc49a4-99c9-42d0-86f1-f44ec2500472 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.242090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:06.247326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf5c30-1baa-4e97-b87d-27bc1d1ad064 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.247764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf5c30-1baa-4e97-b87d-27bc1d1ad064 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.247882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf5c30-1baa-4e97-b87d-27bc1d1ad064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.262657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7253-f593-4ce8-9a77-47e7b3e03887 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.262940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7253-f593-4ce8-9a77-47e7b3e03887 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.263214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7253-f593-4ce8-9a77-47e7b3e03887 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.264541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:06.264902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-90bf5c30-1baa-4e97-b87d-27bc1d1ad064 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:06.266157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-90bf5c30-1baa-4e97-b87d-27bc1d1ad064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:06.270012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.270327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.270610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.309649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG passlib.handlers.bcrypt [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 21:24:06.310083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG passlib.handlers.bcrypt [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 21:24:06.350928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:06.357161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:06.358767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:06.373208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf5c30-1baa-4e97-b87d-27bc1d1ad064 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:06.397322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:06.477833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf5c30-1baa-4e97-b87d-27bc1d1ad064 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:06.479308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:06.500971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:06.512292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:06.513110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.513378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.513657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.525202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:06.537017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:06.537988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:06.538906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:24:06.544054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:06.603151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064ffcb-0034-4395-814d-84fbdaf2f792 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:06.605405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:06.624618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:06.640981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:06.641920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.642228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.643021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f5a8f-86c8-4406-9c59-31cff71ab643 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:06.643137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.677668 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:06.678371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.678662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.678950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.679710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:06.680024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:06.681429 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:06.693209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:06.698713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:06.711579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:06.713121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:06.797747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf08a9-582b-43a2-9ab6-451b0385f41a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:06.810016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:24:06.815954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:06.818864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:06.832289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:06.833162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.833446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.833718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] PATH_INFO: `/v3/users/21d9725cafcc4283be987ee60ded1556` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.845889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] RBAC: Authorizing `identity:get_user(user_id=21d9725cafcc4283be987ee60ded1556)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:06.845889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:06.845889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/users/21d9725cafcc4283be987ee60ded1556 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:06.845889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:06.857178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:06.913596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0b04a-c20e-4625-be18-619a231c34f1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:06.940842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629bbcd-7752-47e8-8bd0-527087cee138 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:06.947141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:06.947933 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.948229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.948510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.967338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:06.968820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:06.974293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:06.975086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:06.975371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:06.975648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:06.976828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:06.978301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:06.979892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 10/18] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:06.985581 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:24:06.989409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:06.990200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:06.991222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:24:06.991222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:24:06.991222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:24:06.991222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:06.991222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 9/19] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:24:06.996227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:07.053160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:07.065906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:07.084562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb4a3-9e7d-4ec8-a3b1-d3fe8b654f94 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:07.097245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440b587-aedc-4fc9-b7d0-a47d1a587db8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:07.119487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3dbf0-d8e1-4c16-824a-62e3bd4a4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:07.120143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3dbf0-d8e1-4c16-824a-62e3bd4a4a94 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:07.120433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3dbf0-d8e1-4c16-824a-62e3bd4a4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:07.120715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3dbf0-d8e1-4c16-824a-62e3bd4a4a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:07.121542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3dbf0-d8e1-4c16-824a-62e3bd4a4a94 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.domain.id=default, user.id=21d9725cafcc4283be987ee60ded1556) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:07.121858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3dbf0-d8e1-4c16-824a-62e3bd4a4a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:07.123368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3dbf0-d8e1-4c16-824a-62e3bd4a4a94 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:07.130519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1322 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/role_assignments?user.id=21d9725cafcc4283be987ee60ded1556&scope.domain.id=default&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:07.131920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225136c2-2299-4a4f-a968-926669d8bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:07.132582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225136c2-2299-4a4f-a968-926669d8bc7e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:07.132867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225136c2-2299-4a4f-a968-926669d8bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:07.133141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225136c2-2299-4a4f-a968-926669d8bc7e None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:07.133871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225136c2-2299-4a4f-a968-926669d8bc7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:07.134179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225136c2-2299-4a4f-a968-926669d8bc7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:07.135647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225136c2-2299-4a4f-a968-926669d8bc7e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:07.157025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:09.720423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5bc7-3e31-41f4-933f-e6ca96f92b2e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:09.721422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5bc7-3e31-41f4-933f-e6ca96f92b2e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:09.721518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5bc7-3e31-41f4-933f-e6ca96f92b2e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:09.722945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:09.728367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a6e4-9c22-46db-8276-e981ddad27bd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:09.729204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a6e4-9c22-46db-8276-e981ddad27bd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:09.729682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a6e4-9c22-46db-8276-e981ddad27bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:09.879776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1076a6e4-9c22-46db-8276-e981ddad27bd None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:09.881310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1076a6e4-9c22-46db-8276-e981ddad27bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:09.968127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:10.000243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5bc7-3e31-41f4-933f-e6ca96f92b2e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:10.037253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bf5d-40d5-4498-9065-7da8ecf5a818 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.037875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bf5d-40d5-4498-9065-7da8ecf5a818 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.038398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bf5d-40d5-4498-9065-7da8ecf5a818 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.040218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:10.045465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5608b-f902-4cfc-81a2-756bb95fe765 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.046004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5608b-f902-4cfc-81a2-756bb95fe765 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.046569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5608b-f902-4cfc-81a2-756bb95fe765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.070226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fbc5608b-f902-4cfc-81a2-756bb95fe765 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:10.071450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fbc5608b-f902-4cfc-81a2-756bb95fe765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:10.155969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:10.181048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5bc7-3e31-41f4-933f-e6ca96f92b2e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:10.205588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:10.231842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5608b-f902-4cfc-81a2-756bb95fe765 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:10.255497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:10.256246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.256532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.256808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.280084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:10.281677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:10.286496 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:24:10.323563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:10.324425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:10.325203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:24:10.325203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:24:10.325203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:24:10.325203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:10.325203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 13/26] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:10.333863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:10.453735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5608b-f902-4cfc-81a2-756bb95fe765 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:10.527259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e0fc-144a-455f-ace0-0ff88bcbbb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:10.527980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e0fc-144a-455f-ace0-0ff88bcbbb16 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.528268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e0fc-144a-455f-ace0-0ff88bcbbb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.528544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e0fc-144a-455f-ace0-0ff88bcbbb16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.539674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c860-4db8-49db-934d-0a64b06755c3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:10.558998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1e0fc-144a-455f-ace0-0ff88bcbbb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7fd1e0fc-144a-455f-ace0-0ff88bcbbb16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:10.572761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:10.573790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:10.574747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:10.577664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 14/27] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:10.580355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f128-d9a4-4b9a-b7cc-1c7733940a28 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.581149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f128-d9a4-4b9a-b7cc-1c7733940a28 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.581649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f128-d9a4-4b9a-b7cc-1c7733940a28 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.583187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 15/28] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:10.584499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e216-83cf-477f-bf89-cd3c8f60f354 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.584984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:10.585230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e216-83cf-477f-bf89-cd3c8f60f354 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.585659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.585929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e216-83cf-477f-bf89-cd3c8f60f354 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.586026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.586234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.586971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:10.587286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:10.588107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 16/29] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:10.589379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0764-7d42-4bdf-a5cd-c0ea4cce7afe None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.589867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0764-7d42-4bdf-a5cd-c0ea4cce7afe None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.590388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0764-7d42-4bdf-a5cd-c0ea4cce7afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.593106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:10.610841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b3af0764-7d42-4bdf-a5cd-c0ea4cce7afe None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:10.612652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b3af0764-7d42-4bdf-a5cd-c0ea4cce7afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:10.614238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 14/30] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:10.614974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:10.651804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:10.693083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:10.700306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 17/31] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:10.701694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaacd4-9418-416a-b7d1-b0667e0a77b4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.706166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaacd4-9418-416a-b7d1-b0667e0a77b4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.706166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaacd4-9418-416a-b7d1-b0667e0a77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.720510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3bbaacd4-9418-416a-b7d1-b0667e0a77b4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:10.721833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3bbaacd4-9418-416a-b7d1-b0667e0a77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:10.742440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1463502-ea07-4579-ac92-9f3eeae486d9 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:10.789977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:10.790925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.791354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.791802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.792708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:10.793162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:10.794752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:10.805402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 15/32] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:10.806451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:10.807497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 18/33] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:10.816200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaacd4-9418-416a-b7d1-b0667e0a77b4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:10.917008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4142e-88a2-423e-b0c2-2e02df7c4a9a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:10.925279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:10.931751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaacd4-9418-416a-b7d1-b0667e0a77b4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:10.936156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:10.953653 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:10.954438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.954766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.955044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.955767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:10.957248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:10.968087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:10.968773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:10.969044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:10.969326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:10.970074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:10.971547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:11.198244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 16/34] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:24:10 2022] POST /identity/v3/projects => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:11.198244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:11.231485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 19/35] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 19 21:24:10 2022] POST /identity/v3/roles => generated 225 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:11.233379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:11.380903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2d5b-3517-4bba-932d-ab9594a3e74c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:11.450062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac05a3a-133a-4d29-af37-5cb8bd7f98ab None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:11.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04ca68-6323-4057-9afe-ae93a2fecec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:11.455135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04ca68-6323-4057-9afe-ae93a2fecec9 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.455427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04ca68-6323-4057-9afe-ae93a2fecec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.455768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04ca68-6323-4057-9afe-ae93a2fecec9 None admin] PATH_INFO: `/v3/users/21d9725cafcc4283be987ee60ded1556` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.457203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04ca68-6323-4057-9afe-ae93a2fecec9 None admin] RBAC: Authorizing `identity:get_user(user_id=21d9725cafcc4283be987ee60ded1556)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:11.458844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04ca68-6323-4057-9afe-ae93a2fecec9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:11.460500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 17/36] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:11 2022] GET /identity/v3/users/21d9725cafcc4283be987ee60ded1556 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:11.461910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44107-0a70-4b80-84c5-ebf3a5a50137 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.462091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44107-0a70-4b80-84c5-ebf3a5a50137 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.463482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44107-0a70-4b80-84c5-ebf3a5a50137 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.465290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 18/37] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:11.466094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44107-0a70-4b80-84c5-ebf3a5a50137 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:11.499624 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9493f-cf2e-4978-8a74-c6214c964f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:11.500323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9493f-cf2e-4978-8a74-c6214c964f97 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.500617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9493f-cf2e-4978-8a74-c6214c964f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.500907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9493f-cf2e-4978-8a74-c6214c964f97 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.502232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9493f-cf2e-4978-8a74-c6214c964f97 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:11.503894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9493f-cf2e-4978-8a74-c6214c964f97 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:11.525547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:11.587145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44107-0a70-4b80-84c5-ebf3a5a50137 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:11.597651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 20/38] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 19 21:24:11 2022] POST /identity/v3/roles => generated 219 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:11.599229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a7b70-b876-4656-ac53-6519efa8768c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.599525 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a7b70-b876-4656-ac53-6519efa8768c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.599931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a7b70-b876-4656-ac53-6519efa8768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.627561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a18a7b70-b876-4656-ac53-6519efa8768c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:11.630050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a18a7b70-b876-4656-ac53-6519efa8768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:11.636616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be395b13-f512-4c07-9517-28f1b234ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:11.637433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395b13-f512-4c07-9517-28f1b234ece8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.637721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395b13-f512-4c07-9517-28f1b234ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.638001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395b13-f512-4c07-9517-28f1b234ece8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.639382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be395b13-f512-4c07-9517-28f1b234ece8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:11.640895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be395b13-f512-4c07-9517-28f1b234ece8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:11.642893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 19/39] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:11.645080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d54e-e627-40e8-a59f-3cffd6517306 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.645080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d54e-e627-40e8-a59f-3cffd6517306 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.645080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d54e-e627-40e8-a59f-3cffd6517306 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.645355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:11.646173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 20/40] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:11.650376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700d54e-e627-40e8-a59f-3cffd6517306 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:11.718333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 21/41] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:11.719876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809f18-4b0f-43d7-99f5-8e9c1efcf6d4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.720354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809f18-4b0f-43d7-99f5-8e9c1efcf6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.720808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809f18-4b0f-43d7-99f5-8e9c1efcf6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.739098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b7809f18-4b0f-43d7-99f5-8e9c1efcf6d4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:11.740611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b7809f18-4b0f-43d7-99f5-8e9c1efcf6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:11.780147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700d54e-e627-40e8-a59f-3cffd6517306 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:11.788880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:11.820098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 22/42] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:11.821452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809f18-4b0f-43d7-99f5-8e9c1efcf6d4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:11.825341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:11.826306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.826605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.826886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] PATH_INFO: `/v3/domains/default/users/21d9725cafcc4283be987ee60ded1556/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.828939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=21d9725cafcc4283be987ee60ded1556, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:11.830979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:11.908039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:11.922907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 21/43] 10.222.0.59 () {58 vars in 1361 bytes} [Thu May 19 21:24:11 2022] PUT /identity/v3/domains/default/users/21d9725cafcc4283be987ee60ded1556/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:24:11.930566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809f18-4b0f-43d7-99f5-8e9c1efcf6d4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:11.931225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:11.971452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:11.972372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:11.972694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:11.972958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:11.973722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:11.975179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:12.040305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91dee-b03d-4407-865b-7af07cead7f8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:12.062319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 19 21:24:11 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:12.087955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeebee6-d11a-4113-9567-5662f39078d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:12.088797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeebee6-d11a-4113-9567-5662f39078d1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:12.089085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeebee6-d11a-4113-9567-5662f39078d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:12.089361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeebee6-d11a-4113-9567-5662f39078d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:12.090715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeebee6-d11a-4113-9567-5662f39078d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:12.092246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeebee6-d11a-4113-9567-5662f39078d1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:12.094268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 22/45] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:12.100237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:12.218793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b5609-d6f6-4346-8ab3-683c383141ac None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:12.255621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1212eb-d60d-4a1e-ab08-e550366c2356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:12.256289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1212eb-d60d-4a1e-ab08-e550366c2356 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:12.256589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1212eb-d60d-4a1e-ab08-e550366c2356 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:12.256878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1212eb-d60d-4a1e-ab08-e550366c2356 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:12.257885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1212eb-d60d-4a1e-ab08-e550366c2356 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:12.259424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1212eb-d60d-4a1e-ab08-e550366c2356 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:12.264155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:12.385141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:24:12 2022] POST /identity/v3/projects => generated 312 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:24:14.149892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ee1f-7b46-436e-b2d6-d0a7604d684e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.150461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ee1f-7b46-436e-b2d6-d0a7604d684e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.150461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ee1f-7b46-436e-b2d6-d0a7604d684e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.151858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 23/47] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:14.157210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bdca-633a-40f7-9438-02680bcb546a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.157603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bdca-633a-40f7-9438-02680bcb546a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.158233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bdca-633a-40f7-9438-02680bcb546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.187051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7c18bdca-633a-40f7-9438-02680bcb546a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:14.188237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7c18bdca-633a-40f7-9438-02680bcb546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:14.254136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 25/48] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:14.277055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82ee1f-7b46-436e-b2d6-d0a7604d684e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:14.311811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:14.378092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82ee1f-7b46-436e-b2d6-d0a7604d684e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:14.410763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:14.411492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.411779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.412056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.424067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:14.432082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:14.432990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:14.433730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 24/49] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:14.439910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18bdca-633a-40f7-9438-02680bcb546a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:14.540814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18bdca-633a-40f7-9438-02680bcb546a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:14.558367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:14.575312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b95c-cba8-463b-8318-8c69e23ad41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:14.575983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b95c-cba8-463b-8318-8c69e23ad41e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.576269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b95c-cba8-463b-8318-8c69e23ad41e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.576551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b95c-cba8-463b-8318-8c69e23ad41e None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.577303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b95c-cba8-463b-8318-8c69e23ad41e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:14.577614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b95c-cba8-463b-8318-8c69e23ad41e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:14.579057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b95c-cba8-463b-8318-8c69e23ad41e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:14.591437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 26/50] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:14.597011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:14.613824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417e58-052b-464c-b0e8-8c81c864c594 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.614121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417e58-052b-464c-b0e8-8c81c864c594 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.614451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417e58-052b-464c-b0e8-8c81c864c594 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.615828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 27/51] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:14.620718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be388fc-75cf-4d79-8a76-3d333266bf4a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.621007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be388fc-75cf-4d79-8a76-3d333266bf4a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.621291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be388fc-75cf-4d79-8a76-3d333266bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.637818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7be388fc-75cf-4d79-8a76-3d333266bf4a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:14.639027 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7be388fc-75cf-4d79-8a76-3d333266bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:14.692787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:14.699193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fd36e-a87d-4594-ba9b-170eea4e7bc8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:14.704324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 28/52] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:14.726656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be388fc-75cf-4d79-8a76-3d333266bf4a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:14.731804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:14.732890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.733506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.733791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] PATH_INFO: `/v3/users/21d9725cafcc4283be987ee60ded1556` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.735034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] RBAC: Authorizing `identity:get_user(user_id=21d9725cafcc4283be987ee60ded1556)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:14.737014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:14.738691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 25/53] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:14 2022] GET /identity/v3/users/21d9725cafcc4283be987ee60ded1556 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:14.743819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:14.825161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be388fc-75cf-4d79-8a76-3d333266bf4a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:14.836334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:14.841178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20bf06-7ad8-4757-966d-79c63439f00d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:14.858429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:14.859215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.859504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.859779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.861437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:14.862924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:14.864544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 29/54] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:14.870733 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:14.883075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:14.883887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:14.884178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:14.884462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:14.885663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:14.887165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:14.889953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 26/55] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:14.899708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:14.930810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:14.975045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfe1bf-b816-4686-8ba2-84ec9ca4817e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:14.998350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d590d-b134-42c9-ba65-1b85bf0573d1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:15.008511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a281a4-bd97-4e3b-a3fd-b75ee55139ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:15.009168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a281a4-bd97-4e3b-a3fd-b75ee55139ad None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:15.009457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a281a4-bd97-4e3b-a3fd-b75ee55139ad None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:15.009737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a281a4-bd97-4e3b-a3fd-b75ee55139ad None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:15.010489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a281a4-bd97-4e3b-a3fd-b75ee55139ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:15.011929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a281a4-bd97-4e3b-a3fd-b75ee55139ad None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:15.030538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45aa92-bad0-4b47-baee-77dd3459a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:15.031197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45aa92-bad0-4b47-baee-77dd3459a44a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:15.031485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45aa92-bad0-4b47-baee-77dd3459a44a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:15.031768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45aa92-bad0-4b47-baee-77dd3459a44a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:15.033124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45aa92-bad0-4b47-baee-77dd3459a44a None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.domain.id=default, user.id=21d9725cafcc4283be987ee60ded1556) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:15.033431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45aa92-bad0-4b47-baee-77dd3459a44a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:15.034956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45aa92-bad0-4b47-baee-77dd3459a44a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:15.040804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 27/56] 10.222.0.59 () {56 vars in 1322 bytes} [Thu May 19 21:24:14 2022] GET /identity/v3/role_assignments?user.id=21d9725cafcc4283be987ee60ded1556&scope.domain.id=default&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:15.112985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 30/57] 10.222.0.59 () {60 vars in 1140 bytes} [Thu May 19 21:24:14 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:24:17.369408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9a83-aa49-4aeb-9b27-a7da3ce96478 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:17.369871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9a83-aa49-4aeb-9b27-a7da3ce96478 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:17.370011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9a83-aa49-4aeb-9b27-a7da3ce96478 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:17.371422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 28/58] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:17.377134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89e5d-4b42-4dac-ab79-e57e9cd6b7ce None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:17.377510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89e5d-4b42-4dac-ab79-e57e9cd6b7ce None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:17.377694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89e5d-4b42-4dac-ab79-e57e9cd6b7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:17.394529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9ef89e5d-4b42-4dac-ab79-e57e9cd6b7ce None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:17.395703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ef89e5d-4b42-4dac-ab79-e57e9cd6b7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:17.418138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:17.460251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 31/59] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:17.484541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c9a83-aa49-4aeb-9b27-a7da3ce96478 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:17.575465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:17.582442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c9a83-aa49-4aeb-9b27-a7da3ce96478 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:17.613921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af2b5-da06-42b5-870d-25b59fec8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:17.614723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af2b5-da06-42b5-870d-25b59fec8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:17.615011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af2b5-da06-42b5-870d-25b59fec8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:17.615286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af2b5-da06-42b5-870d-25b59fec8dd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:17.616434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af2b5-da06-42b5-870d-25b59fec8dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:17.617883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af2b5-da06-42b5-870d-25b59fec8dd6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:17.619486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 29/60] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:17.624905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef89e5d-4b42-4dac-ab79-e57e9cd6b7ce None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:17.719758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef89e5d-4b42-4dac-ab79-e57e9cd6b7ce None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:17.752557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0fd42-35a1-448e-965d-1c3b117d2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:17.753212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0fd42-35a1-448e-965d-1c3b117d2582 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:17.753497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0fd42-35a1-448e-965d-1c3b117d2582 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:17.753773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0fd42-35a1-448e-965d-1c3b117d2582 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:17.754524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0fd42-35a1-448e-965d-1c3b117d2582 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:17.755958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0fd42-35a1-448e-965d-1c3b117d2582 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:17.841880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 32/61] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:24:17 2022] POST /identity/v3/users => generated 275 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:21.127075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58474-6d3b-4bdd-bbf0-e4571158b1ad None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.127583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58474-6d3b-4bdd-bbf0-e4571158b1ad None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.127655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58474-6d3b-4bdd-bbf0-e4571158b1ad None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.129046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 30/62] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:21.134510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f800b-6779-4362-a038-dfd5d076ceac None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.134903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f800b-6779-4362-a038-dfd5d076ceac None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.135086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f800b-6779-4362-a038-dfd5d076ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.152938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-934f800b-6779-4362-a038-dfd5d076ceac None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:21.154138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-934f800b-6779-4362-a038-dfd5d076ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:21.169250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:21.232165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521231-c88c-4206-a651-4657197c312b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.232490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521231-c88c-4206-a651-4657197c312b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.232777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521231-c88c-4206-a651-4657197c312b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.236695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:21.242613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f5eb3-e458-4f10-9a9d-b0236c206a13 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.242908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f5eb3-e458-4f10-9a9d-b0236c206a13 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.243203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f5eb3-e458-4f10-9a9d-b0236c206a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.273721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-f70f5eb3-e458-4f10-9a9d-b0236c206a13 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:21.275263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f70f5eb3-e458-4f10-9a9d-b0236c206a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:21.279186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 33/64] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:21.318117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f800b-6779-4362-a038-dfd5d076ceac None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:21.406030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 32/65] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:21.429602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f5eb3-e458-4f10-9a9d-b0236c206a13 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:21.555201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:21.567809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f5eb3-e458-4f10-9a9d-b0236c206a13 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:21.615011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f800b-6779-4362-a038-dfd5d076ceac None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:21.619892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cc845-f7f7-477f-9d12-57a6261e1e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:21.620914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cc845-f7f7-477f-9d12-57a6261e1e87 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.621379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cc845-f7f7-477f-9d12-57a6261e1e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.621817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cc845-f7f7-477f-9d12-57a6261e1e87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.633634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cc845-f7f7-477f-9d12-57a6261e1e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-797cc845-f7f7-477f-9d12-57a6261e1e87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:21.642647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:21.643674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:21.644586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:21.646551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 33/66] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:24:21.648247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e6b7-b47c-4984-8668-cfcf4a7f09c4 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.648759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e6b7-b47c-4984-8668-cfcf4a7f09c4 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.649250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e6b7-b47c-4984-8668-cfcf4a7f09c4 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.655064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 34/67] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:21.655064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22e6b7-b47c-4984-8668-cfcf4a7f09c4 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:21.660462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dc684-8850-4796-97ac-7f869cf26dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:21.661204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc684-8850-4796-97ac-7f869cf26dcc None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.661491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc684-8850-4796-97ac-7f869cf26dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.661770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc684-8850-4796-97ac-7f869cf26dcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.677036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dc684-8850-4796-97ac-7f869cf26dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-664dc684-8850-4796-97ac-7f869cf26dcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:21.687025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:21.687943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:21.688723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 34/68] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:24:21.694254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d5e2f-e764-4d7b-bcbd-1b2aa290e6d1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.694254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d5e2f-e764-4d7b-bcbd-1b2aa290e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.694254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d5e2f-e764-4d7b-bcbd-1b2aa290e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.708741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:21.715996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-293d5e2f-e764-4d7b-bcbd-1b2aa290e6d1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:21.717315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-293d5e2f-e764-4d7b-bcbd-1b2aa290e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:21.777349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22e6b7-b47c-4984-8668-cfcf4a7f09c4 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:21.788187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 35/69] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:21.789301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d5e2f-e764-4d7b-bcbd-1b2aa290e6d1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:21.819669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b27371-71c1-4377-befd-b044839ac907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:21.820667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27371-71c1-4377-befd-b044839ac907 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.821092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27371-71c1-4377-befd-b044839ac907 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.821505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27371-71c1-4377-befd-b044839ac907 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.822482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b27371-71c1-4377-befd-b044839ac907 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:21.823056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b27371-71c1-4377-befd-b044839ac907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:21.824681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b27371-71c1-4377-befd-b044839ac907 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:21.835317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 35/70] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:21.836728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aea1e6-0592-4446-ad50-f9662bf2c162 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.837157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aea1e6-0592-4446-ad50-f9662bf2c162 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.837598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aea1e6-0592-4446-ad50-f9662bf2c162 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.838866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 36/71] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:21.843274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aea1e6-0592-4446-ad50-f9662bf2c162 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:21.859820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:21.913659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d5e2f-e764-4d7b-bcbd-1b2aa290e6d1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:21.954967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:21.955630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.955910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:21.956187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:21.956927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:21.957318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:21.958652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:21.960737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:21.963701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aea1e6-0592-4446-ad50-f9662bf2c162 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:21.968087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 36/72] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:21.968925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:21.998756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0f151-ecf3-46e5-8be5-7547201c25fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:21.999559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f151-ecf3-46e5-8be5-7547201c25fa None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:21.999852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f151-ecf3-46e5-8be5-7547201c25fa None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.000137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f151-ecf3-46e5-8be5-7547201c25fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.010747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0f151-ecf3-46e5-8be5-7547201c25fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-6cc0f151-ecf3-46e5-8be5-7547201c25fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:22.019045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:22.019863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:22.020599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 37/73] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:22.021702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493462-8f8f-40cd-ad5d-0dd280065a88 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.021868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493462-8f8f-40cd-ad5d-0dd280065a88 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.022120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493462-8f8f-40cd-ad5d-0dd280065a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.037877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ce493462-8f8f-40cd-ad5d-0dd280065a88 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:22.039100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ce493462-8f8f-40cd-ad5d-0dd280065a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:22.070421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06a807-eaa1-432d-8fd3-21f161c804a0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.102686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.103267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 38/74] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:22.103552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.103842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.104125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] PATH_INFO: `/v3/users/21d9725cafcc4283be987ee60ded1556` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.104691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11610eb8-157d-4f08-b5cf-2449a03c1f61 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.104929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11610eb8-157d-4f08-b5cf-2449a03c1f61 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.105207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11610eb8-157d-4f08-b5cf-2449a03c1f61 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.105587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] RBAC: Authorizing `identity:get_user(user_id=21d9725cafcc4283be987ee60ded1556)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.112682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 39/75] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:22.112808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.112892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11610eb8-157d-4f08-b5cf-2449a03c1f61 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.112968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 37/76] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:21 2022] GET /identity/v3/users/21d9725cafcc4283be987ee60ded1556 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:22.112968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.126866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.185173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.219904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce40ab1-c169-463f-a811-c6e9075444d8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.222225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11610eb8-157d-4f08-b5cf-2449a03c1f61 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.253557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdb759-d780-4514-b73a-7bd87c095a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.254255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdb759-d780-4514-b73a-7bd87c095a02 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.254549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdb759-d780-4514-b73a-7bd87c095a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.254832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdb759-d780-4514-b73a-7bd87c095a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.255574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdb759-d780-4514-b73a-7bd87c095a02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:22.255893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdb759-d780-4514-b73a-7bd87c095a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.256122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.256991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.257276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.257356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdb759-d780-4514-b73a-7bd87c095a02 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.257554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.265501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 38/77] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:22.266739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fadaa1-4b30-4df8-aac6-7d1f095d2f1a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.267037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fadaa1-4b30-4df8-aac6-7d1f095d2f1a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.267348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fadaa1-4b30-4df8-aac6-7d1f095d2f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.271858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.273323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.275042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 40/78] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:22.275797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.285918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e4fadaa1-4b30-4df8-aac6-7d1f095d2f1a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:22.286814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e4fadaa1-4b30-4df8-aac6-7d1f095d2f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:22.337374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.353855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 39/79] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:22.357358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fadaa1-4b30-4df8-aac6-7d1f095d2f1a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.375152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c4002-023c-44c5-83d6-cf50b47742b8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.409549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.410205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.410529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.410819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.415877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.456782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fadaa1-4b30-4df8-aac6-7d1f095d2f1a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.476143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.477607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.491345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.492147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.492440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.492714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.502618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:22.510691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:22.511484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:22.512221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 40/80] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:22.512832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.538450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.576007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 41/81] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:22.576832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.615300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dde49-c98a-4e4e-bd9a-a5b4a8f75fe9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.632012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.648290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.649153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.649437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.649712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.650906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.652358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.653973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 41/82] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:22.653973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.672650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fdb63-b0f0-4871-9211-54d5a0653ae9 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.706533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.707244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.707473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.707754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.738477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.755416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5a0c3-e703-48f5-8e5e-ad630fa083ee None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.776020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.777503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.788870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.789652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.789936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.790228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.791380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.792803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.794420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 42/83] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:22.795190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.848817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.879424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 42/84] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:22.880264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.896955 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bab15-3237-40c1-8538-5331d6812ad4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:22.933941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:22.937895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:22.937895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:22.937895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:22.939349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:22.939684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:22.941084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:22.942371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:22.950532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 43/85] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:22.951338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:22.988003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbeb4e-ef0b-4aa6-bde9-96e34cdd692d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.020730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.021589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.021869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.022143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.023337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.024781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.026484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 43/86] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:23.027220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.050930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edfc16-f823-4eef-b604-f52b672abdd1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.067220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:23.084505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.085147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.085441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.085731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.127933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa812bd1-3a51-4009-8215-f96f3a609e8b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.151648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.153236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.155229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:23.161214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.161877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.162162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.162596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.163306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.164734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.256659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 44/87] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:23.257444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.276976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 44/88] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:24:23 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:23.277823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.280005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:23.372566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9678-1af0-4bac-9566-2042dd07be54 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.392346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592d28-84f9-4521-80e4-62c938adc8b8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.408760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.409656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.409949 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.410263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.411546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.413169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.419956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 45/89] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:23 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:23.419956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.439649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.440557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.440845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.441929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.443254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.444770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.450853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 45/90] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:23 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:23.450853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.520591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:23.532887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:23.551868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59dda8-4a11-424d-b9d8-c54e00decb40 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.577311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc655e-18dc-4ce7-8ddd-583a682c0344 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.600290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.600961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.601244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.601521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.602412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=21d9725cafcc4283be987ee60ded1556) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:23.602720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.604171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.614127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 46/91] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:23 2022] GET /identity/v3/role_assignments?user.id=21d9725cafcc4283be987ee60ded1556&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:23.615019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.627823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.628726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.629010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.629297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] PATH_INFO: `/v3/projects/12b333650eb6493795df4b00f70a6673` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.631333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] RBAC: Authorizing `identity:get_project(project_id=12b333650eb6493795df4b00f70a6673)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.632864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.638391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 46/92] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:23 2022] GET /identity/v3/projects/12b333650eb6493795df4b00f70a6673 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:23.638391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.786309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdb13-b309-46cc-8680-3dd694591c00 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.800189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa83fe-6d98-4fcc-8bdb-b58dee1a02a8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:23.835938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:23.842723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.843449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.843738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.844021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.845602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=32af80d933f54c68b0bb6a2f4faaedf4) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:23.849741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:23.849741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:23.853633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 47/93] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:23 2022] GET /identity/v3/role_assignments?user.id=32af80d933f54c68b0bb6a2f4faaedf4&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:23.854568 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:23.868803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:23.869709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:23.870257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:23.870560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:23.872335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:23.977960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067c56-1ef9-4492-a8f2-fc54063c7591 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:24.016756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:24.018107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:24.018435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:24.018770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:24.019623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=12b333650eb6493795df4b00f70a6673, user.id=32af80d933f54c68b0bb6a2f4faaedf4) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:24.019992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:24.021492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:24.028178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 48/94] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:23 2022] GET /identity/v3/role_assignments?user.id=32af80d933f54c68b0bb6a2f4faaedf4&scope.project.id=12b333650eb6493795df4b00f70a6673&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:24.078447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:24.080515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:24.240597 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 47/95] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:24.246455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:24.358996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:24.391510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9f69-16a4-4cc4-9756-735a0508bbe1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:24.436736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5eedf-3ec0-45c8-bd3e-964ca4635a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:24.437608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5eedf-3ec0-45c8-bd3e-964ca4635a69 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:24.437905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5eedf-3ec0-45c8-bd3e-964ca4635a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:24.438190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5eedf-3ec0-45c8-bd3e-964ca4635a69 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:24.439510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5eedf-3ec0-45c8-bd3e-964ca4635a69 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:24.440982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5eedf-3ec0-45c8-bd3e-964ca4635a69 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:24.443003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 49/96] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:24 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:24.448803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:24.497091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:24.586202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083574e-fac8-4aaf-bbf4-6f0ea05a7788 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:24.622041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04aeea-d8ef-4e3e-bc22-ab95479012c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:24.623067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04aeea-d8ef-4e3e-bc22-ab95479012c7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:24.623554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04aeea-d8ef-4e3e-bc22-ab95479012c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:24.624034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04aeea-d8ef-4e3e-bc22-ab95479012c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:24.625077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04aeea-d8ef-4e3e-bc22-ab95479012c7 None admin] RBAC: Adding query filter params (role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=32af80d933f54c68b0bb6a2f4faaedf4) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:24.625592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04aeea-d8ef-4e3e-bc22-ab95479012c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:24.627859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04aeea-d8ef-4e3e-bc22-ab95479012c7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:24.634127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 48/97] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:24 2022] GET /identity/v3/role_assignments?user.id=32af80d933f54c68b0bb6a2f4faaedf4&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:26.447744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcac6-7a2e-4162-a558-dfd3907726dc None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:26.448767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcac6-7a2e-4162-a558-dfd3907726dc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:26.449265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcac6-7a2e-4162-a558-dfd3907726dc None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:26.450895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 50/98] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:26.456284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49748f37-baa4-4677-b7c1-464049016811 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:26.456724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49748f37-baa4-4677-b7c1-464049016811 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:26.456895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49748f37-baa4-4677-b7c1-464049016811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:26.479351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-49748f37-baa4-4677-b7c1-464049016811 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:26.480575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-49748f37-baa4-4677-b7c1-464049016811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:26.571930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 49/99] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:26.614861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dcac6-7a2e-4162-a558-dfd3907726dc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:26.776432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dcac6-7a2e-4162-a558-dfd3907726dc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:26.800967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b41ec-3a64-4d2f-91fc-0a8a7dc686ce None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:26.801264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b41ec-3a64-4d2f-91fc-0a8a7dc686ce None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:26.801549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b41ec-3a64-4d2f-91fc-0a8a7dc686ce None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:26.802958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 50/100] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:26.811008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967021f-bb6d-4b99-8ed3-7769fbee4931 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:26.811711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967021f-bb6d-4b99-8ed3-7769fbee4931 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:26.812208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967021f-bb6d-4b99-8ed3-7769fbee4931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:26.812722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464960f9-fc95-49d5-bede-7372393465c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:26.814253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464960f9-fc95-49d5-bede-7372393465c9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:26.814550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464960f9-fc95-49d5-bede-7372393465c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:26.814832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464960f9-fc95-49d5-bede-7372393465c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464960f9-fc95-49d5-bede-7372393465c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-464960f9-fc95-49d5-bede-7372393465c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:26.834315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:26.835143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:26.835943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 51/101] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:26.837437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abd696-6cf3-4886-8929-062b621f28cd None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:26.837437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abd696-6cf3-4886-8929-062b621f28cd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:26.837437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abd696-6cf3-4886-8929-062b621f28cd None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:26.840163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 52/102] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:26.847609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee155f1-9845-48f2-92f1-4a89e6f4f97b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:26.848076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee155f1-9845-48f2-92f1-4a89e6f4f97b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:26.848441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee155f1-9845-48f2-92f1-4a89e6f4f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:26.855401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b967021f-bb6d-4b99-8ed3-7769fbee4931 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:26.856960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b967021f-bb6d-4b99-8ed3-7769fbee4931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:26.857193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:26.872199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2ee155f1-9845-48f2-92f1-4a89e6f4f97b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:26.873624 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2ee155f1-9845-48f2-92f1-4a89e6f4f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:26.885086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:27.007258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 51/103] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:27.009091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967021f-bb6d-4b99-8ed3-7769fbee4931 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.027211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 53/104] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:27.054891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee155f1-9845-48f2-92f1-4a89e6f4f97b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.230250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967021f-bb6d-4b99-8ed3-7769fbee4931 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:27.235287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee155f1-9845-48f2-92f1-4a89e6f4f97b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:27.265991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9945b9-7b39-4d57-bbcd-31e763ba6d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:27.267572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9945b9-7b39-4d57-bbcd-31e763ba6d8f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.268102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9945b9-7b39-4d57-bbcd-31e763ba6d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.268527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9945b9-7b39-4d57-bbcd-31e763ba6d8f None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.269411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9945b9-7b39-4d57-bbcd-31e763ba6d8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:27.269869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9945b9-7b39-4d57-bbcd-31e763ba6d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:27.271636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9945b9-7b39-4d57-bbcd-31e763ba6d8f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:27.276106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:27.279113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.279113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.279113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.280207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:27.281664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:27.288583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 54/105] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:27.288583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.295266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:27.297945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 52/106] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:27.299539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646921-3314-422c-b9cd-d54e720ff77b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.300044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646921-3314-422c-b9cd-d54e720ff77b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.300513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646921-3314-422c-b9cd-d54e720ff77b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.302051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 53/107] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:27.302973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646921-3314-422c-b9cd-d54e720ff77b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.314823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:27.419668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832ab9-e2f0-4ad1-b16c-399003d354eb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:27.421554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646921-3314-422c-b9cd-d54e720ff77b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:27.458274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc6ac4-37a0-4b8a-93a1-a2f4b94d2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:27.459862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6ac4-37a0-4b8a-93a1-a2f4b94d2e6e None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.460323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6ac4-37a0-4b8a-93a1-a2f4b94d2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.460778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6ac4-37a0-4b8a-93a1-a2f4b94d2e6e None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.461663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc6ac4-37a0-4b8a-93a1-a2f4b94d2e6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:27.462523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:27.463405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.463765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.464116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.464381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc6ac4-37a0-4b8a-93a1-a2f4b94d2e6e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:27.477624 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:27.494728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:27.495647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 55/108] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:27.496405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.552138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 54/109] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:24:27 2022] POST /identity/v3/projects => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:27.558312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa95d18-74da-43ab-8998-41d17ae15f20 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.558312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa95d18-74da-43ab-8998-41d17ae15f20 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.558312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa95d18-74da-43ab-8998-41d17ae15f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.571067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:27.576377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5fa95d18-74da-43ab-8998-41d17ae15f20 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:27.577601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5fa95d18-74da-43ab-8998-41d17ae15f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:27.637191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d9fb3-167a-4060-b21c-2c3e75b470a1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:27.650955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:27.664274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 55/110] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:27.665464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa95d18-74da-43ab-8998-41d17ae15f20 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.712297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efb82c-1164-4627-8c00-9b70cda97462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:27.714064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb82c-1164-4627-8c00-9b70cda97462 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.714064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb82c-1164-4627-8c00-9b70cda97462 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.714064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb82c-1164-4627-8c00-9b70cda97462 None admin] PATH_INFO: `/v3/users/8ff929e430f6431db8f4ce6eb79546df` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.737892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efb82c-1164-4627-8c00-9b70cda97462 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff929e430f6431db8f4ce6eb79546df)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:27.740112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efb82c-1164-4627-8c00-9b70cda97462 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:27.742937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 56/111] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:27 2022] GET /identity/v3/users/8ff929e430f6431db8f4ce6eb79546df => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:27.745348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc3644-c7fd-44df-96dc-23b7fec6b2c1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.745801 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc3644-c7fd-44df-96dc-23b7fec6b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.746239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc3644-c7fd-44df-96dc-23b7fec6b2c1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.748846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 57/112] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:27.749912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc3644-c7fd-44df-96dc-23b7fec6b2c1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.805569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa95d18-74da-43ab-8998-41d17ae15f20 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:27.853434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:27.854398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.854829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.855271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.856224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:27.856784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:27.858521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:27.877271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 56/113] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:27.883691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:27.897817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc3644-c7fd-44df-96dc-23b7fec6b2c1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:27.920686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:27.937029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee9b6b-346a-4650-9f01-894f8f5c4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:27.938201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee9b6b-346a-4650-9f01-894f8f5c4767 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.938947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee9b6b-346a-4650-9f01-894f8f5c4767 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.939428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee9b6b-346a-4650-9f01-894f8f5c4767 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:27.950571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:27.952991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee9b6b-346a-4650-9f01-894f8f5c4767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-37ee9b6b-346a-4650-9f01-894f8f5c4767 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:27.966779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:27.967713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:27.968451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:27.981358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 58/114] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:27.981358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bacc53-63f2-46a6-b8a8-703f1cea962e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:27.981358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bacc53-63f2-46a6-b8a8-703f1cea962e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:27.981358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bacc53-63f2-46a6-b8a8-703f1cea962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.004939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-02bacc53-63f2-46a6-b8a8-703f1cea962e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:28.006568 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-02bacc53-63f2-46a6-b8a8-703f1cea962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:28.018656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448b49-c8ed-4e7c-b558-3d773c075af0 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.055754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.056458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.056750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.057029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.099162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 59/115] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:28.099829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bacc53-63f2-46a6-b8a8-703f1cea962e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.151600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.154282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.210454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.226911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bacc53-63f2-46a6-b8a8-703f1cea962e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.239017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.262590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.263388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.263674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.263957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] PATH_INFO: `/v3/users/21d9725cafcc4283be987ee60ded1556` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.264985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 57/116] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:28.265831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.271478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] RBAC: Authorizing `identity:get_user(user_id=21d9725cafcc4283be987ee60ded1556)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.276256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.278905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 60/117] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/users/21d9725cafcc4283be987ee60ded1556 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:28.279353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.377267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca448bba-45e6-4925-beaf-e7ee769a785f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.385897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b5473-87f8-4602-8bf3-af5f96b97230 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.413941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981a127-48cf-4a66-bbbe-cea5ba9372ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.414716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a127-48cf-4a66-bbbe-cea5ba9372ad None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.415039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a127-48cf-4a66-bbbe-cea5ba9372ad None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.415314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a127-48cf-4a66-bbbe-cea5ba9372ad None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.416033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981a127-48cf-4a66-bbbe-cea5ba9372ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:28.416413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981a127-48cf-4a66-bbbe-cea5ba9372ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.417744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981a127-48cf-4a66-bbbe-cea5ba9372ad None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.422106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.422964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.423251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.423532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.426419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 58/118] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:28.427789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046e927-1a30-4441-80b7-91ee68174c0f None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.428085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046e927-1a30-4441-80b7-91ee68174c0f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.428379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046e927-1a30-4441-80b7-91ee68174c0f None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.429769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 59/119] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:28.434601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046e927-1a30-4441-80b7-91ee68174c0f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.439637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:28.447672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:28.448635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:28.449387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:28.453551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 61/120] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:28.454826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.455215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.496717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.545805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046e927-1a30-4441-80b7-91ee68174c0f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.556973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63210357-ff60-49f3-b7c7-d7917bb3bf07 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.581885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.582778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.583072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.583355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.584536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.585982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.592288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 60/121] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:28.592288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.597515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aced6-0ac1-4ecc-a5c4-09b20d17377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.598407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aced6-0ac1-4ecc-a5c4-09b20d17377b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.598699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aced6-0ac1-4ecc-a5c4-09b20d17377b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.598983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aced6-0ac1-4ecc-a5c4-09b20d17377b None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.600185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aced6-0ac1-4ecc-a5c4-09b20d17377b None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.601610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aced6-0ac1-4ecc-a5c4-09b20d17377b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.603337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 62/122] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:28.604475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5c61-9da2-44cf-abb4-b0631d8c8961 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.604767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5c61-9da2-44cf-abb4-b0631d8c8961 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.605050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5c61-9da2-44cf-abb4-b0631d8c8961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.621726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ffdc5c61-9da2-44cf-abb4-b0631d8c8961 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:28.623240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ffdc5c61-9da2-44cf-abb4-b0631d8c8961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:28.680866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.690923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 63/123] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:28.699096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5c61-9da2-44cf-abb4-b0631d8c8961 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.699716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d789-8a64-4ea9-9161-a1d5e3221ca6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.738227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.745147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.746088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.746397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.746686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.747887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.752234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.752234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 61/124] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:28.752558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.815764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5c61-9da2-44cf-abb4-b0631d8c8961 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.866235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.866235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.866235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.866235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.866688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:28.866688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.866688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.866906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1031f-5edd-46cf-9f3a-94f7d54da8c5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:28.871284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 64/125] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:28.872101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.901035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:28.901686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:28.902203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:28.902335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:28.903090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] RBAC: Adding query filter params (role.id=f52e0f4285db4c30ab63860a4fc840b1, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=8ff929e430f6431db8f4ce6eb79546df) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:28.903411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:28.904860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:28.910878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 62/126] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/role_assignments?user.id=8ff929e430f6431db8f4ce6eb79546df&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=f52e0f4285db4c30ab63860a4fc840b1 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:28.923823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:28.950709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.986456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:28.990942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e23f4-6df5-4336-a21c-2e6d2d9dbe33 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.042397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.044342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.044836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.045329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350/users/21d9725cafcc4283be987ee60ded1556/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.048871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8254b1130be4804a04301c20cc1c350, user_id=21d9725cafcc4283be987ee60ded1556, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:29.051305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:29.062645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988545-7d64-4a7b-92c6-4611f18dd9a4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.103299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.104039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.115758 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:29.124117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:29.125013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 63/127] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:24:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:29.126790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:29.133784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 65/128] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:28 2022] PUT /identity/v3/projects/e8254b1130be4804a04301c20cc1c350/users/21d9725cafcc4283be987ee60ded1556/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:29.135226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:29.269721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaadba-c0af-45bf-87cd-346f6c61f1e2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.272239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:29.318914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.320341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.320974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.321479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.322989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:29.324690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:29.326878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 66/129] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:29 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:29.328251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:29.362741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:29.371746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3eade-81bc-40cb-8b5f-331f3d80a141 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.450972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.451841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.452184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.452529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.454578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:29.455001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4bbf3-0867-4cf0-86a8-7dafbbd060aa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.456064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:29.457785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 64/130] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:29 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:29.463029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:29.505223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.506682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.507199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.507688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.508639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:29.509788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:29.511946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:29.524066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 67/131] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:24:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:29.525216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:29.588033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dfa92-d3f9-43b1-aba4-d0db8c77c02c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.633657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.635470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.635941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.636859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] PATH_INFO: `/v3/projects/12b333650eb6493795df4b00f70a6673` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.638690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] RBAC: Authorizing `identity:get_project(project_id=12b333650eb6493795df4b00f70a6673)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:29.641195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:29.643862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 65/132] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:29 2022] GET /identity/v3/projects/12b333650eb6493795df4b00f70a6673 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:29.645013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:29.656361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:29.671621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:29.678113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d7e3c-6593-40bb-b1b1-96fc1da125e4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.747397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.748305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.748586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.748863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350/users/32af80d933f54c68b0bb6a2f4faaedf4/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.754184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] RBAC: Authorizing `identity:create_grant(project_id=e8254b1130be4804a04301c20cc1c350, user_id=32af80d933f54c68b0bb6a2f4faaedf4, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:29.755693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:29.806122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7568627-bce6-41eb-8e9f-7ea3c836813f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:29.847041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:29.847948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:29.848234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:29.848512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:29.849787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:29.851373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:29.853445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 66/133] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:29 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:29.854348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:29.869285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 68/134] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:29 2022] PUT /identity/v3/projects/e8254b1130be4804a04301c20cc1c350/users/32af80d933f54c68b0bb6a2f4faaedf4/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:29.870160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:30.006699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:30.025147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9b32-a5a2-4c02-b478-e4e17027d4b3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:30.061715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe8686-3ca7-46af-92ca-d9fecbd9f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:30.062654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe8686-3ca7-46af-92ca-d9fecbd9f70e None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:30.062945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe8686-3ca7-46af-92ca-d9fecbd9f70e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:30.063260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe8686-3ca7-46af-92ca-d9fecbd9f70e None admin] PATH_INFO: `/v3/projects/12b333650eb6493795df4b00f70a6673/users/32af80d933f54c68b0bb6a2f4faaedf4/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:30.065280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe8686-3ca7-46af-92ca-d9fecbd9f70e None admin] RBAC: Authorizing `identity:create_grant(project_id=12b333650eb6493795df4b00f70a6673, user_id=32af80d933f54c68b0bb6a2f4faaedf4, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:30.067341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe8686-3ca7-46af-92ca-d9fecbd9f70e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:30.105730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab5aae-a12a-4a22-bb2c-c57bac32159f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:30.145466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 67/135] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:29 2022] PUT /identity/v3/projects/12b333650eb6493795df4b00f70a6673/users/32af80d933f54c68b0bb6a2f4faaedf4/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:30.147480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32120f7-fc4f-4221-aae6-32cf78a0785d None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:30.147480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32120f7-fc4f-4221-aae6-32cf78a0785d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:30.147480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32120f7-fc4f-4221-aae6-32cf78a0785d None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:30.149061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 68/136] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:30.158111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:30.158490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4c1e6-2382-4ef4-a895-09f9ef9802fc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:30.158695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:30.158796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4c1e6-2382-4ef4-a895-09f9ef9802fc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:30.158992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:30.159251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4c1e6-2382-4ef4-a895-09f9ef9802fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:30.159345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:30.162402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:30.163989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:30.165891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 69/137] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:29 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:30.174478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:30.206866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-99d4c1e6-2382-4ef4-a895-09f9ef9802fc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:30.208123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-99d4c1e6-2382-4ef4-a895-09f9ef9802fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:30.211771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:30.322337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dfb06-af54-4410-8367-ead176af984d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:30.345841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 69/138] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:30.367030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:30.367956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:30.368239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:30.368516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350/users/32af80d933f54c68b0bb6a2f4faaedf4/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:30.376715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8254b1130be4804a04301c20cc1c350, user_id=32af80d933f54c68b0bb6a2f4faaedf4, role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:30.378763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:30.388177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4c1e6-2382-4ef4-a895-09f9ef9802fc None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:30.456465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 70/139] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:30 2022] PUT /identity/v3/projects/e8254b1130be4804a04301c20cc1c350/users/32af80d933f54c68b0bb6a2f4faaedf4/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:24:30.489604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:30.533393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4c1e6-2382-4ef4-a895-09f9ef9802fc None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:30.590036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dd06a-9e20-4e51-8baa-2cf12331cbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:30.590894 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dd06a-9e20-4e51-8baa-2cf12331cbcd None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:30.591185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dd06a-9e20-4e51-8baa-2cf12331cbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:30.591464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dd06a-9e20-4e51-8baa-2cf12331cbcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:30.592678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dd06a-9e20-4e51-8baa-2cf12331cbcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:30.594158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dd06a-9e20-4e51-8baa-2cf12331cbcd None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:30.596209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 70/140] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:30.601779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:30.723826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:30.746353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e349554-796b-4128-b15c-1c6146ec5ac1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:30.780801 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b93af-2637-439c-b007-d545a9875734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:30.781470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b93af-2637-439c-b007-d545a9875734 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:30.781757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b93af-2637-439c-b007-d545a9875734 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:30.782607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b93af-2637-439c-b007-d545a9875734 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:30.783522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b93af-2637-439c-b007-d545a9875734 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:30.784934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b93af-2637-439c-b007-d545a9875734 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:30.892745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 71/141] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:24:30 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:32.019136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee70ed4-fcf0-4894-8dde-aed42d77cfbb None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.019655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee70ed4-fcf0-4894-8dde-aed42d77cfbb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.019743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee70ed4-fcf0-4894-8dde-aed42d77cfbb None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:32.021082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 71/142] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:32.026578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f8f6-1ecd-4b3f-ad9d-120e9749d9c7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.027075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f8f6-1ecd-4b3f-ad9d-120e9749d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.027225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f8f6-1ecd-4b3f-ad9d-120e9749d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:32.048098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-db42f8f6-1ecd-4b3f-ad9d-120e9749d9c7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:32.049300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-db42f8f6-1ecd-4b3f-ad9d-120e9749d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:32.147729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 72/143] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:32.180612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee70ed4-fcf0-4894-8dde-aed42d77cfbb None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:32.310881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee70ed4-fcf0-4894-8dde-aed42d77cfbb None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:32.357690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:32.358532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.358825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.359108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:32.362680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:32.371039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:32.379558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:32.380381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:32.381136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 72/144] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:32.388502 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f8f6-1ecd-4b3f-ad9d-120e9749d9c7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:32.462658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:32.508645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f8f6-1ecd-4b3f-ad9d-120e9749d9c7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:32.548042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639df593-f3ae-464d-bfe6-dc3379ac49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:32.548642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639df593-f3ae-464d-bfe6-dc3379ac49d9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.548929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639df593-f3ae-464d-bfe6-dc3379ac49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.549205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639df593-f3ae-464d-bfe6-dc3379ac49d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:32.549954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639df593-f3ae-464d-bfe6-dc3379ac49d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:32.550277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639df593-f3ae-464d-bfe6-dc3379ac49d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:32.551666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639df593-f3ae-464d-bfe6-dc3379ac49d9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:32.563672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 73/145] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:32.569671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:32.652098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6b5a-b934-4779-868e-dec8347d9e55 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.652418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6b5a-b934-4779-868e-dec8347d9e55 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.652667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6b5a-b934-4779-868e-dec8347d9e55 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:32.654048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 74/146] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:32.663534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42abf6-c4c6-421d-a41e-e3e87578f44a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.663827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42abf6-c4c6-421d-a41e-e3e87578f44a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.664111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42abf6-c4c6-421d-a41e-e3e87578f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:32.697753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6b42abf6-c4c6-421d-a41e-e3e87578f44a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:32.698960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6b42abf6-c4c6-421d-a41e-e3e87578f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:32.706967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98e585-b5fe-43e6-8dbd-3bbe2207151e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:32.759903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:32.760795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.761079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.761359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] PATH_INFO: `/v3/users/21d9725cafcc4283be987ee60ded1556` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:32.762604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] RBAC: Authorizing `identity:get_user(user_id=21d9725cafcc4283be987ee60ded1556)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:32.764084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:32.765722 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 73/147] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:32 2022] GET /identity/v3/users/21d9725cafcc4283be987ee60ded1556 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:32.771398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:32.866665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:32.880979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 75/148] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:32.909619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19040b-0de0-4253-ac8d-e8fdb23e3163 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:32.914187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42abf6-c4c6-421d-a41e-e3e87578f44a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:32.953643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:32.954336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:32.954626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:32.954907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:33.044060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:33.045556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:33.054611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:33.102833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42abf6-c4c6-421d-a41e-e3e87578f44a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:33.142617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:33.182971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:33.183877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:33.184135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:33.184417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:33.192906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 74/149] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:33.198610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:33.207128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:33.215174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:33.216022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:33.216756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 76/150] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:33.223742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:33.449085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19ff0e-3226-49b9-b9bc-369f0cb7803a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:33.484377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76632a3-7c0c-4234-beca-c83218030c6f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:33.513264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:33.541451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:33.542367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:33.542663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:33.542942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:33.546985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:33.549161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:33.551299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 75/151] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:33 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:33.556786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:33.558849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:33.559706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:33.562562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:33.563090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:33.564559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:33.565012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:33.566939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:33.585731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 77/152] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:33.592044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:33.645047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:33.826230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f575a9-be6d-4eee-8ac2-9c399f601f70 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:33.832360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d10f-d91a-407f-9df8-ce530db540d5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:33.912826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:33.914231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:33.914666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:33.915102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] PATH_INFO: `/v3/users/8ff929e430f6431db8f4ce6eb79546df` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:33.919017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff929e430f6431db8f4ce6eb79546df)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:33.920752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:33.922855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 78/153] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:33 2022] GET /identity/v3/users/8ff929e430f6431db8f4ce6eb79546df => generated 289 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:33.928408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:33.935123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e99c8-87b3-4046-8812-4d3fe877a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:33.935814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e99c8-87b3-4046-8812-4d3fe877a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:33.936099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e99c8-87b3-4046-8812-4d3fe877a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:33.936373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e99c8-87b3-4046-8812-4d3fe877a8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:33.937215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e99c8-87b3-4046-8812-4d3fe877a8d7 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=21d9725cafcc4283be987ee60ded1556) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:33.937528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e99c8-87b3-4046-8812-4d3fe877a8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:33.939651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e99c8-87b3-4046-8812-4d3fe877a8d7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:33.952792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 76/154] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:33 2022] GET /identity/v3/role_assignments?user.id=21d9725cafcc4283be987ee60ded1556&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:33.988985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8970c1-11a4-424c-9908-379c3aab3065 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:33.989262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8970c1-11a4-424c-9908-379c3aab3065 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:33.989538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8970c1-11a4-424c-9908-379c3aab3065 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:33.991174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 77/155] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:33.996877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f24b7-eb39-4b25-88eb-a25616a7ad9a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:33.997160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f24b7-eb39-4b25-88eb-a25616a7ad9a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:33.997435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f24b7-eb39-4b25-88eb-a25616a7ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.035082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-260f24b7-eb39-4b25-88eb-a25616a7ad9a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:34.035503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:34.036276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-260f24b7-eb39-4b25-88eb-a25616a7ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:34.090247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceec7a-a412-4938-8372-3075d472b8f9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:34.164847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:34.166061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.166555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.167000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.169643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:34.171592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:34.173743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 79/156] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:33 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:34.179995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:34.236244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 78/157] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:34.237639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79327dca-52dc-4fb0-b609-026dd842134c None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.237931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79327dca-52dc-4fb0-b609-026dd842134c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.238222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79327dca-52dc-4fb0-b609-026dd842134c None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.239636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 79/158] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:34.245795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15dc11-155b-459f-8c26-f18a8c5ba0e6 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.246081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15dc11-155b-459f-8c26-f18a8c5ba0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.246386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15dc11-155b-459f-8c26-f18a8c5ba0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.291412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ae15dc11-155b-459f-8c26-f18a8c5ba0e6 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:34.292625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ae15dc11-155b-459f-8c26-f18a8c5ba0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:34.338195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:34.378843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a2cd-6562-4e99-89f7-f21a2af42fb5 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:34.402535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:34.432635 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 80/159] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:34.439114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15dc11-155b-459f-8c26-f18a8c5ba0e6 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:34.449718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fe1bc-b1f6-4afc-abcf-b33274251240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:34.450641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fe1bc-b1f6-4afc-abcf-b33274251240 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.450924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fe1bc-b1f6-4afc-abcf-b33274251240 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.451201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fe1bc-b1f6-4afc-abcf-b33274251240 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350/users/8ff929e430f6431db8f4ce6eb79546df/roles/f52e0f4285db4c30ab63860a4fc840b1` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.454814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fe1bc-b1f6-4afc-abcf-b33274251240 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8254b1130be4804a04301c20cc1c350, user_id=8ff929e430f6431db8f4ce6eb79546df, role_id=f52e0f4285db4c30ab63860a4fc840b1)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:34.456262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fe1bc-b1f6-4afc-abcf-b33274251240 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:34.532106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 80/160] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:34 2022] PUT /identity/v3/projects/e8254b1130be4804a04301c20cc1c350/users/8ff929e430f6431db8f4ce6eb79546df/roles/f52e0f4285db4c30ab63860a4fc840b1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:34.533619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8083d-9adb-459b-8819-21b21401068f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.533943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8083d-9adb-459b-8819-21b21401068f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.534247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8083d-9adb-459b-8819-21b21401068f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.540273 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 81/161] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:34.541315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8083d-9adb-459b-8819-21b21401068f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:34.617376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15dc11-155b-459f-8c26-f18a8c5ba0e6 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:34.686991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59694a17-7ed7-44ed-9450-d7899c290915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:34.687712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59694a17-7ed7-44ed-9450-d7899c290915 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.688533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59694a17-7ed7-44ed-9450-d7899c290915 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.690570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59694a17-7ed7-44ed-9450-d7899c290915 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.705855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59694a17-7ed7-44ed-9450-d7899c290915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-59694a17-7ed7-44ed-9450-d7899c290915 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:34.714186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:34.715226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:34.715978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 81/162] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:34.717152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673479-f367-4720-8af4-d4fe7a199e06 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.717297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673479-f367-4720-8af4-d4fe7a199e06 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.717530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673479-f367-4720-8af4-d4fe7a199e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.736962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e2673479-f367-4720-8af4-d4fe7a199e06 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:34.738205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e2673479-f367-4720-8af4-d4fe7a199e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:34.752947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:34.784123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8083d-9adb-459b-8819-21b21401068f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:34.817045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 82/163] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:34.823219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673479-f367-4720-8af4-d4fe7a199e06 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:34.889662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:34.890493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.890776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.891601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.923214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:34.931000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:34.931860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:34.932606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:34.938601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 82/164] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:34.939422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:34.948862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673479-f367-4720-8af4-d4fe7a199e06 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:34.984544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:34.985245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:34.985527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:34.985797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:34.986566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:34.988110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:34.988110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:34.997234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 83/165] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:34.997929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:35.009166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:35.027249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:35.110204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745df46-93c7-4590-994d-2a096439ea80 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:35.147190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:35.148009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.148292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.148565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.149306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:35.149614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:35.151381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:35.160337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 84/166] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:35.161385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:35.188763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10c13d-07de-4747-938b-ad36dc66e53c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:35.248399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:35.272796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6200e7c-67fc-4ce9-9e13-c758e188a6a1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:35.299513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b73ba-a813-4297-becb-6e86e7b12f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:35.300422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b73ba-a813-4297-becb-6e86e7b12f53 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.300608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b73ba-a813-4297-becb-6e86e7b12f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.300878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b73ba-a813-4297-becb-6e86e7b12f53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.319375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:35.319869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b73ba-a813-4297-becb-6e86e7b12f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:35.320819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.321295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.321757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.323166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:35.324800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:35.326694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 85/167] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:35 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:35.327809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-791b73ba-a813-4297-becb-6e86e7b12f53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:35.331308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:35.332178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:35.333327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:35.338783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 83/168] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:35.338783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac20459-8646-450f-852f-fb7d0f1d2fbd None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.338783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac20459-8646-450f-852f-fb7d0f1d2fbd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.338783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac20459-8646-450f-852f-fb7d0f1d2fbd None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.338783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 84/169] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:35.338783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac20459-8646-450f-852f-fb7d0f1d2fbd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:35.489128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:35.499814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac20459-8646-450f-852f-fb7d0f1d2fbd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:35.505575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520796-d436-44c0-a6fc-bbaaf7f4b487 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:35.546432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3cf02-47bc-4d58-b31c-29edb3a8c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:35.547632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:35.547970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3cf02-47bc-4d58-b31c-29edb3a8c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.548281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.548563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.548841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.548939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3cf02-47bc-4d58-b31c-29edb3a8c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.549397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3cf02-47bc-4d58-b31c-29edb3a8c8b7 None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.550821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3cf02-47bc-4d58-b31c-29edb3a8c8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:35.552464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3cf02-47bc-4d58-b31c-29edb3a8c8b7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:35.554644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 86/170] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:35 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:35.555996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d38fa-a2c7-499f-bf00-9c97be1ee39e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.556479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d38fa-a2c7-499f-bf00-9c97be1ee39e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.557158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d38fa-a2c7-499f-bf00-9c97be1ee39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.570438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:35.576938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-3e3d38fa-a2c7-499f-bf00-9c97be1ee39e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:35.579226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3e3d38fa-a2c7-499f-bf00-9c97be1ee39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:35.652002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 87/171] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:35.653395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d38fa-a2c7-499f-bf00-9c97be1ee39e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:35.745816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:35.747272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:35.757936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d38fa-a2c7-499f-bf00-9c97be1ee39e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:35.800209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:35.801392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:35.802484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:35.803084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:35.804934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:35.805607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:35.807909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:35.822708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 88/172] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:24:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:35.823324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:35.827831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:35.933120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:35.944073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 85/173] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:35.944975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.055907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590054c-c6d0-4b05-89e0-a6ffaefbf7b0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.064659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53dbaf-4fd7-4817-bb17-1365c4f9c187 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.091046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.091948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.092230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.092501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.103534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:36.111688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:36.112559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:36.113730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 86/174] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:36.114598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.126076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6922-7bef-4917-99e7-ebd459150609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.127016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6922-7bef-4917-99e7-ebd459150609 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.127502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6922-7bef-4917-99e7-ebd459150609 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.127955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6922-7bef-4917-99e7-ebd459150609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.169809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.200273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.204519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d6922-7bef-4917-99e7-ebd459150609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:36.206323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d6922-7bef-4917-99e7-ebd459150609 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:36.219003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a7a4d-e5ff-4338-810f-9396698af3e8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.254153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.255092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.255409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.255770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] PATH_INFO: `/v3/users/32af80d933f54c68b0bb6a2f4faaedf4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.256944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] RBAC: Authorizing `identity:get_user(user_id=32af80d933f54c68b0bb6a2f4faaedf4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:36.258514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:36.264446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 87/175] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/users/32af80d933f54c68b0bb6a2f4faaedf4 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:36.264446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.320618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 89/176] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:36.320618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0736eb-1bc8-4b04-a8c7-e698e80868cd None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.320618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0736eb-1bc8-4b04-a8c7-e698e80868cd None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.320618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0736eb-1bc8-4b04-a8c7-e698e80868cd None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.320618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 90/177] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:36.320618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0736eb-1bc8-4b04-a8c7-e698e80868cd None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.383860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa46c0-e6ef-4b5b-bb2d-7d6354990a41 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.405045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.424193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a52be7-04e9-467b-8550-c170fcb6eecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.425042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52be7-04e9-467b-8550-c170fcb6eecd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.425322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52be7-04e9-467b-8550-c170fcb6eecd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.425595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a52be7-04e9-467b-8550-c170fcb6eecd None admin] PATH_INFO: `/v3/projects/12b333650eb6493795df4b00f70a6673` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.426797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a52be7-04e9-467b-8550-c170fcb6eecd None admin] RBAC: Authorizing `identity:get_project(project_id=12b333650eb6493795df4b00f70a6673)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:36.427172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.428295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a52be7-04e9-467b-8550-c170fcb6eecd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:36.429976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 88/178] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/projects/12b333650eb6493795df4b00f70a6673 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:36.431337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fceec0-b45d-4067-af4e-628931ccddea None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.431789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fceec0-b45d-4067-af4e-628931ccddea None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.432206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fceec0-b45d-4067-af4e-628931ccddea None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.433582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 89/179] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:36.434442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fceec0-b45d-4067-af4e-628931ccddea None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.439480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0736eb-1bc8-4b04-a8c7-e698e80868cd None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.478618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.479290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.479578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.479856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.480607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:36.480920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:36.482372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:36.491031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 91/180] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:36.492090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.556646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fceec0-b45d-4067-af4e-628931ccddea None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.591302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.591878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.592169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.592452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.595029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67483-ccad-4b16-993d-0dacef700f09 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.642064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0390a-295a-43d6-9a33-d379734ea280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.642963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0390a-295a-43d6-9a33-d379734ea280 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.643244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0390a-295a-43d6-9a33-d379734ea280 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.643518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0390a-295a-43d6-9a33-d379734ea280 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.644791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0390a-295a-43d6-9a33-d379734ea280 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:36.646277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0390a-295a-43d6-9a33-d379734ea280 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:36.647963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 92/181] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:36.649091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e2b7-4b2d-406a-b579-1483b32cd950 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.649374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e2b7-4b2d-406a-b579-1483b32cd950 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.649651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e2b7-4b2d-406a-b579-1483b32cd950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.665608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0185e2b7-4b2d-406a-b579-1483b32cd950 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:36.666795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0185e2b7-4b2d-406a-b579-1483b32cd950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:36.667313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.679871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:36.681451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:36.692039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.738374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 93/182] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:36.748383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e199c-dfa5-4ada-be91-5066ccf1fa10 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.748680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e199c-dfa5-4ada-be91-5066ccf1fa10 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.748961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e199c-dfa5-4ada-be91-5066ccf1fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.769808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0d7e199c-dfa5-4ada-be91-5066ccf1fa10 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:36.771049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0d7e199c-dfa5-4ada-be91-5066ccf1fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:36.788368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 90/183] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:36.793555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.846321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 94/184] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:36.846321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e199c-dfa5-4ada-be91-5066ccf1fa10 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:36.907113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.920484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f9be-6b67-490f-bda8-c293ddbbbea1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.949221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:36.958609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:36.959269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:36.959555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:36.959835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:36.960731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=12b333650eb6493795df4b00f70a6673, user.id=32af80d933f54c68b0bb6a2f4faaedf4) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:36.961042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:36.961859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e199c-dfa5-4ada-be91-5066ccf1fa10 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:36.962536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:36.969091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 91/185] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/role_assignments?user.id=32af80d933f54c68b0bb6a2f4faaedf4&scope.project.id=12b333650eb6493795df4b00f70a6673&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:36.978519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.013928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.014857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.015152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.015432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] PATH_INFO: `/v3/users/7a1a9ebed8d04349930156ab90dcb9f8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.030737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] RBAC: Authorizing `identity:get_user(user_id=7a1a9ebed8d04349930156ab90dcb9f8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.032366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.034126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 95/186] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/users/7a1a9ebed8d04349930156ab90dcb9f8 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:37.039285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.094060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fa918-8433-4d22-bd19-8547fe9009c1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.136642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.136642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.136642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.136642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.137040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=32af80d933f54c68b0bb6a2f4faaedf4) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:37.137040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.138435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.146286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 92/187] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:36 2022] GET /identity/v3/role_assignments?user.id=32af80d933f54c68b0bb6a2f4faaedf4&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:37.147387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.150832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273afee3-01c0-4e92-abda-b7369085de65 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.181526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:37.219677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.220521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.220803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.221077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.245507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:37.253905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:37.255190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:37.256153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:37.258315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 96/188] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:37.258315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.273514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:37.363356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c48e0-f1d5-4641-9f2f-9d8f81f98e56 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.397182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63bda-47d8-4e6d-b81a-432e7eeb1ba7 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.414722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.416024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.416509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.417028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.418485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.420291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.422344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 93/189] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:37.423446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.443920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.445263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.445711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.445999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.447524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.449461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.451355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 97/190] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:37.452079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.530295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:37.544745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:37.550389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051cf1-e7ef-445b-a4fd-bab21d48b56e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.571592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e8a74-8e78-490a-8705-29fece8f7356 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.585278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.585924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.586205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.586507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.605593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.606289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.606592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.606854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.607599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:37.607909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.609290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.617632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 98/191] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:37.619100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.654872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.656247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.715341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdbf24-3dad-4531-b263-086e914f6fba None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.735348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:37.749067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186ac28-a8e6-4bb2-a34a-cda5f06e0347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.749897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ac28-a8e6-4bb2-a34a-cda5f06e0347 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.750006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ac28-a8e6-4bb2-a34a-cda5f06e0347 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.750280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ac28-a8e6-4bb2-a34a-cda5f06e0347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.751104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186ac28-a8e6-4bb2-a34a-cda5f06e0347 None admin] RBAC: Adding query filter params (role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=32af80d933f54c68b0bb6a2f4faaedf4) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:37.751416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186ac28-a8e6-4bb2-a34a-cda5f06e0347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.751545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 94/192] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:37.752311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.752886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186ac28-a8e6-4bb2-a34a-cda5f06e0347 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.756168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:37.761257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 99/193] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/role_assignments?user.id=32af80d933f54c68b0bb6a2f4faaedf4&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:37.762381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc8b0-4a95-4ffe-8886-0765b20397a8 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.762676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc8b0-4a95-4ffe-8886-0765b20397a8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.762951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc8b0-4a95-4ffe-8886-0765b20397a8 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.764237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 100/194] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:37.764866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc8b0-4a95-4ffe-8886-0765b20397a8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.867945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0a75e-cf2f-4a9f-9ab9-132910b5c941 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.882200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc8b0-4a95-4ffe-8886-0765b20397a8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:37.908038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a33ce-1d1c-488d-a7d2-a18b30bacb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.908636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a33ce-1d1c-488d-a7d2-a18b30bacb00 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.908924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a33ce-1d1c-488d-a7d2-a18b30bacb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.909210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a33ce-1d1c-488d-a7d2-a18b30bacb00 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.909945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a33ce-1d1c-488d-a7d2-a18b30bacb00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.911499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a33ce-1d1c-488d-a7d2-a18b30bacb00 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.920804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:37.922061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:37.922546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:37.922815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] PATH_INFO: `/v3/users/7a1a9ebed8d04349930156ab90dcb9f8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:37.924075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] RBAC: Authorizing `identity:get_user(user_id=7a1a9ebed8d04349930156ab90dcb9f8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:37.925567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:37.927256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 101/195] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/users/7a1a9ebed8d04349930156ab90dcb9f8 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:37.928051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:37.996702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.012328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 95/196] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:24:37 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:38.013936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51270e-7ee2-42d7-ab27-823df2082a88 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.014654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51270e-7ee2-42d7-ab27-823df2082a88 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.016353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51270e-7ee2-42d7-ab27-823df2082a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.038629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4e51270e-7ee2-42d7-ab27-823df2082a88 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:38.039950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4e51270e-7ee2-42d7-ab27-823df2082a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:38.046917 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62728cfe-31b0-4cb6-a30d-f2e82d011784 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.084854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.087574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.088466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.088754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.089032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.090303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:38.091778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:38.093730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 102/197] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:37 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:38.095051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.128158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 96/198] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:38.129239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51270e-7ee2-42d7-ab27-823df2082a88 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.230290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c8559-a71b-408a-9221-cd2f39cac2c7 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.253177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51270e-7ee2-42d7-ab27-823df2082a88 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.268136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.268795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.269079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.269359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.273656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.303359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.304030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.304314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.304585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.305418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=7a1a9ebed8d04349930156ab90dcb9f8) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:38.305728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:38.307224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:38.314260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 97/199] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/role_assignments?user.id=7a1a9ebed8d04349930156ab90dcb9f8&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:38.315414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.359160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.372381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:38.373903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:38.444467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2e19b-5e72-469f-a002-b13216e94083 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.487165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.488411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.488915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.489390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.491923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 103/200] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:38.503116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.508404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:38.517549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:38.518574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:38.519557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:38.521744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 98/201] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:38.527790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.547003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.630735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63091dad-111f-4cf6-8b50-2c73e7be036f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.662260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.674394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be403-b072-4123-ac4d-58af0778e674 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.696386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.697498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.697998 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.698443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.699897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:38.702754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:38.706018 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 104/202] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:38.714811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.729874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.731011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.731497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.731969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.732907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:38.733429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:38.735644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:38.746312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 99/203] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:38.755198 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.862663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3267-0291-40ff-b211-92afc921352e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.899133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.900051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.900333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.900651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] PATH_INFO: `/v3/users/8ff929e430f6431db8f4ce6eb79546df` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.901949 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] RBAC: Authorizing `identity:get_user(user_id=8ff929e430f6431db8f4ce6eb79546df)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:38.903701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:38.914367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 100/204] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/users/8ff929e430f6431db8f4ce6eb79546df => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:38.914367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:38.942261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.946457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30167-e601-4b56-be70-4f8e5ad1903b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:38.949591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:38.991221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:38.992212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:38.992675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:38.993131 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:38.994131 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] RBAC: Adding query filter params (role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=7a1a9ebed8d04349930156ab90dcb9f8) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:38.994720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:38.996462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:39.010615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 105/205] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/role_assignments?user.id=7a1a9ebed8d04349930156ab90dcb9f8&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:39.023091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299aeea-062c-48ee-bc81-b2652e8616ad None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:39.061022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:39.061684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:39.061960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:39.062309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:39.140763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:39.143426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:39.174519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:39.290898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 101/206] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:24:39.296508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:39.411716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdf296-4cc2-4dc9-881a-889ec9124fdc None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:39.446455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047842cd-e509-4772-bcc2-d5c5ecb5ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:39.447313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047842cd-e509-4772-bcc2-d5c5ecb5ece0 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:39.447598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047842cd-e509-4772-bcc2-d5c5ecb5ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:39.447871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047842cd-e509-4772-bcc2-d5c5ecb5ece0 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:39.449054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047842cd-e509-4772-bcc2-d5c5ecb5ece0 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:39.450513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047842cd-e509-4772-bcc2-d5c5ecb5ece0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:39.457430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 106/207] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:39 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:39.458834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:39.563480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201bb9-c15e-43af-900b-f23ccddf1013 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:39.587727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:39.598806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b93726-e4bb-474a-8817-77e868378ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:39.599463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93726-e4bb-474a-8817-77e868378ebe None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:39.599744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93726-e4bb-474a-8817-77e868378ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:39.600020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93726-e4bb-474a-8817-77e868378ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:39.600846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93726-e4bb-474a-8817-77e868378ebe None admin] RBAC: Adding query filter params (role.id=f52e0f4285db4c30ab63860a4fc840b1, scope.project.id=e8254b1130be4804a04301c20cc1c350, user.id=8ff929e430f6431db8f4ce6eb79546df) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:39.601155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93726-e4bb-474a-8817-77e868378ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:39.602609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93726-e4bb-474a-8817-77e868378ebe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:39.608500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 102/208] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:39 2022] GET /identity/v3/role_assignments?user.id=8ff929e430f6431db8f4ce6eb79546df&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=f52e0f4285db4c30ab63860a4fc840b1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:40.685882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5143-0733-4ed9-9575-20d14a6b2ece None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:40.686417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5143-0733-4ed9-9575-20d14a6b2ece None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:40.686524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5143-0733-4ed9-9575-20d14a6b2ece None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:40.687845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 107/209] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:40.693358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8753de-0912-4576-86d8-51e42481d092 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:40.693775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8753de-0912-4576-86d8-51e42481d092 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:40.693945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8753de-0912-4576-86d8-51e42481d092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:40.710689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cf8753de-0912-4576-86d8-51e42481d092 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:40.712139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cf8753de-0912-4576-86d8-51e42481d092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:40.785273 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 103/210] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:40.808837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5143-0733-4ed9-9575-20d14a6b2ece None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:40.851295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:40.922932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5143-0733-4ed9-9575-20d14a6b2ece None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:40.959162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:40.959890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:40.960173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:40.960449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:40.964206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f036a03-2510-42e8-9c64-0ede5ab2266f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:40.964495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f036a03-2510-42e8-9c64-0ede5ab2266f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:40.964773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f036a03-2510-42e8-9c64-0ede5ab2266f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:40.966330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 104/211] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:40.971576 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b40c-50fe-4923-bfd1-35b7b9d518fe None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:40.972124 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b40c-50fe-4923-bfd1-35b7b9d518fe None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:40.972662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b40c-50fe-4923-bfd1-35b7b9d518fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:40.975881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:40.986078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:40.987155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:40.987927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 108/212] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:40.993029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:40.994420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-53e6b40c-50fe-4923-bfd1-35b7b9d518fe None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:40.995814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-53e6b40c-50fe-4923-bfd1-35b7b9d518fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:41.066597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 105/213] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:41.074054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e2b01-d3c4-4339-85b4-5e3e73093658 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.074054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e2b01-d3c4-4339-85b4-5e3e73093658 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.074054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e2b01-d3c4-4339-85b4-5e3e73093658 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.074054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 106/214] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:41.075175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b69ba7-ed6e-474f-9f58-29d5251010b1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.075462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b69ba7-ed6e-474f-9f58-29d5251010b1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.075738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b69ba7-ed6e-474f-9f58-29d5251010b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.093227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-65b69ba7-ed6e-474f-9f58-29d5251010b1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:41.095015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-65b69ba7-ed6e-474f-9f58-29d5251010b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:41.106606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:41.112432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942a40-187a-4386-9534-12e57fa51304 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.141575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:41.150518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.151386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.151669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.152096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.153045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:41.153577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:41.155137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:41.163787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 109/215] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:41.165379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 107/216] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:41.170279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.170436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b69ba7-ed6e-474f-9f58-29d5251010b1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.275320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b69ba7-ed6e-474f-9f58-29d5251010b1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.283701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e2642-ed4b-4c9f-9134-83fa38be3cde None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.319614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.320034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.320490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.320776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.320866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.321051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] PATH_INFO: `/v3/users/83ad65894cf944c79471c899e6293a14` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.321153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.321355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.322544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:41.325170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:41.327116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 110/217] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:41.330854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.341298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] RBAC: Authorizing `identity:get_user(user_id=83ad65894cf944c79471c899e6293a14)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:41.343659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:41.346089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 108/218] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/users/83ad65894cf944c79471c899e6293a14 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:41.347299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.366691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:41.388423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:41.443259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae22a1-72b6-4dd7-ba28-2a34d09e25cd None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.459456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7884cc5-c56e-4f5d-9ddf-609f51ce047e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.478801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.479593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.479878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.480148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.491744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:41.496736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.497386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.497667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.497938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.498675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:41.499541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:41.500925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:41.506657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:41.507255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:41.507342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 111/219] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:41.507342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.576731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 109/220] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:24:41 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:41.577674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.596357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:41.616106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728b119-1d31-4811-b9be-18e828a1e4a2 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.654549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d283272-e4c5-4718-b3e2-f10abce81340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.655222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d283272-e4c5-4718-b3e2-f10abce81340 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.655512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d283272-e4c5-4718-b3e2-f10abce81340 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.655794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d283272-e4c5-4718-b3e2-f10abce81340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.685615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:41.695947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8efd0-488a-4816-ad0a-fe830647a3d9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.732870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d283272-e4c5-4718-b3e2-f10abce81340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:41.733409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16643f54-6258-4030-be6d-ed4d71908f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.734066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16643f54-6258-4030-be6d-ed4d71908f21 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.734408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16643f54-6258-4030-be6d-ed4d71908f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.735228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16643f54-6258-4030-be6d-ed4d71908f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.736092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d283272-e4c5-4718-b3e2-f10abce81340 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:41.736255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16643f54-6258-4030-be6d-ed4d71908f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:41.740288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16643f54-6258-4030-be6d-ed4d71908f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:41.741852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16643f54-6258-4030-be6d-ed4d71908f21 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:41.753361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 110/221] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:41.759025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd7ea-06e7-4437-b47c-f39abfd2b806 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.759025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd7ea-06e7-4437-b47c-f39abfd2b806 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.759025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd7ea-06e7-4437-b47c-f39abfd2b806 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.759025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 111/222] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:41.761577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbd7ea-06e7-4437-b47c-f39abfd2b806 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.840569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:41.857400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 112/223] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:41.858748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba77816-718f-4032-a8ee-16e058f9932e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.859044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba77816-718f-4032-a8ee-16e058f9932e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.859320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba77816-718f-4032-a8ee-16e058f9932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.880152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8ba77816-718f-4032-a8ee-16e058f9932e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:41.881719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8ba77816-718f-4032-a8ee-16e058f9932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:41.896107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbd7ea-06e7-4437-b47c-f39abfd2b806 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:41.949814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:41.950778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:41.951226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:41.954006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] PATH_INFO: `/v3/users/7a1a9ebed8d04349930156ab90dcb9f8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:41.954006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] RBAC: Authorizing `identity:get_user(user_id=7a1a9ebed8d04349930156ab90dcb9f8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:41.955698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:41.957855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 112/224] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/users/7a1a9ebed8d04349930156ab90dcb9f8 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:41.959399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.986974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 113/225] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:41.988111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba77816-718f-4032-a8ee-16e058f9932e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:41.998557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:42.105507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f57907-e0de-4e82-9e7f-f1d7b5508c35 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.110418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba77816-718f-4032-a8ee-16e058f9932e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.129475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:42.148283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.149245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.149644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.149995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.151411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:42.152322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.153243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.157618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:42.157737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.157737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.157737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:42.157969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 114/226] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:42.157969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:42.159419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:42.162997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 113/227] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:41 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:42.165019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:42.277307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9151-990c-4c43-ba2a-0de6321a9e79 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.293298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:42.303072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4a6c-b77f-49ab-8b2e-e345616aeace None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.325439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.326639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.326936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.327227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.340184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.341697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:42.341810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.342661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.343290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/7a1a9ebed8d04349930156ab90dcb9f8/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.346053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] RBAC: Authorizing `identity:create_grant(project_id=27fd3f52f375402f8263c68266fcd5f0, user_id=7a1a9ebed8d04349930156ab90dcb9f8, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:42.347770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:42.352440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:42.353333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:42.354107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 115/228] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:24:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:42.355502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:42.402074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:42.426866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 114/229] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:42 2022] PUT /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/7a1a9ebed8d04349930156ab90dcb9f8/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:42.426866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:42.499440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4584c0-44d8-4023-bed1-9e9a3b075f6d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.572076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e979-c1ca-45c9-9136-023f08ac80ad None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.586513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.587232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.587568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.587846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.588759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=83ad65894cf944c79471c899e6293a14) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:42.589104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:42.590599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:42.603810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 116/230] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:42 2022] GET /identity/v3/role_assignments?user.id=83ad65894cf944c79471c899e6293a14&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:42.629887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.630594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.630880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.631158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.631975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:42.632285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:42.633753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:42.644490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 115/231] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:24:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:42.650159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:42.764421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6788-a5bd-4361-af0d-32e08830a035 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.774205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:42.801047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.801977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.802290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.802570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] PATH_INFO: `/v3/users/7a1a9ebed8d04349930156ab90dcb9f8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.803845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] RBAC: Authorizing `identity:get_user(user_id=7a1a9ebed8d04349930156ab90dcb9f8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:42.805330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:42.807383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 117/232] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:42 2022] GET /identity/v3/users/7a1a9ebed8d04349930156ab90dcb9f8 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:42.813449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:42.834827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:42.943249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a96e-0343-45d1-a1d9-c41c55589353 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:42.991847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a38c7e-5fea-4e00-8bf8-8e5987934891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:42.992713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38c7e-5fea-4e00-8bf8-8e5987934891 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:42.993012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38c7e-5fea-4e00-8bf8-8e5987934891 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:42.993291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38c7e-5fea-4e00-8bf8-8e5987934891 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:42.994913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a38c7e-5fea-4e00-8bf8-8e5987934891 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:42.996367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a38c7e-5fea-4e00-8bf8-8e5987934891 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:42.998098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 116/233] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:42 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:43.004571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:43.143186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04b5a2-b6f8-4c9f-a3ef-617b1a625123 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:43.193039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5c578-ca52-452f-b25f-50de78f829b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:43.193932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c578-ca52-452f-b25f-50de78f829b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:43.194243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c578-ca52-452f-b25f-50de78f829b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:43.194513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c578-ca52-452f-b25f-50de78f829b9 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/7a1a9ebed8d04349930156ab90dcb9f8/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:43.199009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5c578-ca52-452f-b25f-50de78f829b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=27fd3f52f375402f8263c68266fcd5f0, user_id=7a1a9ebed8d04349930156ab90dcb9f8, role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:43.200527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5c578-ca52-452f-b25f-50de78f829b9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:43.295600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 118/234] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:43 2022] PUT /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/7a1a9ebed8d04349930156ab90dcb9f8/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:44.347351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e8041-8cec-41c5-a420-1a74ab825ecb None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:44.347881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e8041-8cec-41c5-a420-1a74ab825ecb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:44.347881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e8041-8cec-41c5-a420-1a74ab825ecb None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:44.349430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 117/235] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:44.353120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958959-9b0d-4718-a9aa-7f9b8417133b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:44.353511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958959-9b0d-4718-a9aa-7f9b8417133b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:44.353692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958959-9b0d-4718-a9aa-7f9b8417133b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:44.355090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 119/236] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:44.360328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe63c-42c4-4f1f-89e3-f92a31481bbc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:44.360629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe63c-42c4-4f1f-89e3-f92a31481bbc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:44.360919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe63c-42c4-4f1f-89e3-f92a31481bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:44.363521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4b823-c0f0-4055-8e42-29f5dfc6fb81 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:44.363812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4b823-c0f0-4055-8e42-29f5dfc6fb81 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:44.364091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4b823-c0f0-4055-8e42-29f5dfc6fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:44.393561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-301fe63c-42c4-4f1f-89e3-f92a31481bbc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:44.394782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-301fe63c-42c4-4f1f-89e3-f92a31481bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:44.399247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a2a4b823-c0f0-4055-8e42-29f5dfc6fb81 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:44.400418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a2a4b823-c0f0-4055-8e42-29f5dfc6fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:44.457630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:44.518149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 120/237] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:44.520466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 118/238] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:44.568151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4b823-c0f0-4055-8e42-29f5dfc6fb81 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:44.571281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fe63c-42c4-4f1f-89e3-f92a31481bbc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:44.590470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:44.673988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4b823-c0f0-4055-8e42-29f5dfc6fb81 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:44.708907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:44.710019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:44.710434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:44.710802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:44.721003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:44.728743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:44.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:44.730693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:44.731616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 121/239] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:44.737974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:44.784428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:44.812361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fe63c-42c4-4f1f-89e3-f92a31481bbc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:44.862774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f0471-aac2-428e-bd05-40d28a1c00b7 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:44.901811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:44.902735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:44.903024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:44.903294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:44.904064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:44.904371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:44.905813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:44.917659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 122/240] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:44.923614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:44.942931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:44.943744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:44.944035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:44.944310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:44.945522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:44.947006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:44.948823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 119/241] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:44.954394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:45.030600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:45.042537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbbfac-3b97-4c73-865e-5c064eda4b8d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:45.074712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:45.093551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fbe0d-11d0-4c12-9b2d-67928c5bb064 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:45.094898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:45.095772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.096057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.096339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] PATH_INFO: `/v3/users/5e7c6ef01a0149d18bbdb917a6017463` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.111000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] RBAC: Authorizing `identity:get_user(user_id=5e7c6ef01a0149d18bbdb917a6017463)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:45.112741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:45.114938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 123/242] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:44 2022] GET /identity/v3/users/5e7c6ef01a0149d18bbdb917a6017463 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:45.127156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:45.145038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ff649-946e-4798-b30a-297b38ab57be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:45.145711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ff649-946e-4798-b30a-297b38ab57be None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.145993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ff649-946e-4798-b30a-297b38ab57be None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.146290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ff649-946e-4798-b30a-297b38ab57be None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.147019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ff649-946e-4798-b30a-297b38ab57be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:45.148462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ff649-946e-4798-b30a-297b38ab57be None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:45.247932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb14fcc-c036-4ed1-86d3-69de5e73fa00 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:45.272519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 120/243] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:24:44 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:45.274083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362327c6-68f9-41bb-9cb7-464ef66e3c2b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.274396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362327c6-68f9-41bb-9cb7-464ef66e3c2b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.274727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362327c6-68f9-41bb-9cb7-464ef66e3c2b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.276093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 121/244] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:45.290281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1382c-7d5e-4c82-bfbd-3920e963c96e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.290281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1382c-7d5e-4c82-bfbd-3920e963c96e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.290281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1382c-7d5e-4c82-bfbd-3920e963c96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.307895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646a009-e0b7-4cd9-b555-b95be21f09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:45.308565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646a009-e0b7-4cd9-b555-b95be21f09ed None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.308853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646a009-e0b7-4cd9-b555-b95be21f09ed None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.309132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646a009-e0b7-4cd9-b555-b95be21f09ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.326023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4ca1382c-7d5e-4c82-bfbd-3920e963c96e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:45.327272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4ca1382c-7d5e-4c82-bfbd-3920e963c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:45.351542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:45.460344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646a009-e0b7-4cd9-b555-b95be21f09ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:45.462697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646a009-e0b7-4cd9-b555-b95be21f09ed None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:45.489521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 122/245] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:45.521712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1382c-7d5e-4c82-bfbd-3920e963c96e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:45.589238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 124/246] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:45.590924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb3a8-946b-44a1-831f-df33a015a846 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.591212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb3a8-946b-44a1-831f-df33a015a846 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.591601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb3a8-946b-44a1-831f-df33a015a846 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.593142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 125/247] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:45.594670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb3a8-946b-44a1-831f-df33a015a846 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:45.596150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:45.646822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1382c-7d5e-4c82-bfbd-3920e963c96e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:45.654644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:45.689757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b054a4a-858d-47c8-a0bd-bc4deb155802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:45.690951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b054a4a-858d-47c8-a0bd-bc4deb155802 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.691307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b054a4a-858d-47c8-a0bd-bc4deb155802 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.691656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b054a4a-858d-47c8-a0bd-bc4deb155802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.704785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b054a4a-858d-47c8-a0bd-bc4deb155802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-5b054a4a-858d-47c8-a0bd-bc4deb155802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:45.718330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:45.719854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:24:45.720648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:45.722415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 123/248] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:24:45.724596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97d13-da41-4a18-aba2-55f95d4c72c8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.724596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97d13-da41-4a18-aba2-55f95d4c72c8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.724596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97d13-da41-4a18-aba2-55f95d4c72c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.734074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb3a8-946b-44a1-831f-df33a015a846 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:45.755287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-94d97d13-da41-4a18-aba2-55f95d4c72c8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:45.756610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-94d97d13-da41-4a18-aba2-55f95d4c72c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:45.784332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:45.785626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.786111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.786615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.788181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:45.789981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:45.792463 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 126/249] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:45 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:45.793590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:45.846390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 124/250] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:45.847387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d97d13-da41-4a18-aba2-55f95d4c72c8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:45.937176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:45.939514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cb9c2-6cf2-4216-8acc-72f5ee20f667 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:45.959443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:45.985094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:45.986103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:45.986547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:45.986980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:45.987562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d97d13-da41-4a18-aba2-55f95d4c72c8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:45.988094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:45.988550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:45.991108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:46.001823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 127/251] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:46.003078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:46.033467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:46.034688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.035423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.035843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.037521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] RBAC: Adding query filter params (role.id=f52e0f4285db4c30ab63860a4fc840b1, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=5e7c6ef01a0149d18bbdb917a6017463) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:46.038023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:46.040590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:46.049258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 125/252] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:45 2022] GET /identity/v3/role_assignments?user.id=5e7c6ef01a0149d18bbdb917a6017463&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=f52e0f4285db4c30ab63860a4fc840b1 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:46.050286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:46.191245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032dd0-d43d-44f8-a73e-77c2243a7bb1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:46.212045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:46.228536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf92fd9-7984-45d1-9ac9-b9b61b597a70 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:46.232603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6a60-7352-4ed6-9c16-ac2ebf6cc4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:46.233829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6a60-7352-4ed6-9c16-ac2ebf6cc4ff None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.234320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6a60-7352-4ed6-9c16-ac2ebf6cc4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.234738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6a60-7352-4ed6-9c16-ac2ebf6cc4ff None admin] PATH_INFO: `/v3/users/7a1a9ebed8d04349930156ab90dcb9f8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.236212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6a60-7352-4ed6-9c16-ac2ebf6cc4ff None admin] RBAC: Authorizing `identity:get_user(user_id=7a1a9ebed8d04349930156ab90dcb9f8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:46.237821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6a60-7352-4ed6-9c16-ac2ebf6cc4ff None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:46.240081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 126/253] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:46 2022] GET /identity/v3/users/7a1a9ebed8d04349930156ab90dcb9f8 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:46.241517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45bcd-0854-4808-ac0c-3656380a68ac None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.241936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45bcd-0854-4808-ac0c-3656380a68ac None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.242376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45bcd-0854-4808-ac0c-3656380a68ac None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.243875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 127/254] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:46.245159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45bcd-0854-4808-ac0c-3656380a68ac None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:46.334987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b5f5-5a05-4a04-846d-8d4a0f842ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:46.335807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b5f5-5a05-4a04-846d-8d4a0f842ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.336099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b5f5-5a05-4a04-846d-8d4a0f842ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.336373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b5f5-5a05-4a04-846d-8d4a0f842ec5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.347358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285b5f5-5a05-4a04-846d-8d4a0f842ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-a285b5f5-5a05-4a04-846d-8d4a0f842ec5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:46.355125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:46.356005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:46.357185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 128/255] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:46.358013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709336-f84d-4865-90ac-defd5996e73c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.358170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709336-f84d-4865-90ac-defd5996e73c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.359143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709336-f84d-4865-90ac-defd5996e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.385461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ee709336-f84d-4865-90ac-defd5996e73c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:46.387599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45bcd-0854-4808-ac0c-3656380a68ac None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:46.388200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ee709336-f84d-4865-90ac-defd5996e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:46.442252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:46.466687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:46.467351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.467635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.467912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.504196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 129/256] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:46.505095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709336-f84d-4865-90ac-defd5996e73c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:46.594333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:46.621188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:46.623033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:46.668147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709336-f84d-4865-90ac-defd5996e73c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:46.741810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:46.742883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.743378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.743908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.744950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:46.745502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:46.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:46.763877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 130/257] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:46.765012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:46.816940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 128/258] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:24:46.827257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:46.853961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:46.914153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e647a-4218-48b9-a0e4-d0581154754d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:46.956968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:46.958316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:46.960271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:46.960826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:46.974050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:46.983598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:46.985090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:24:46.985874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:46.989285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 131/259] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:24:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:46.990456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:47.071676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:47.116259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3b5da-4802-4a3b-9566-0da41fa8122a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:47.152223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:47.165208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8efee2-52b9-40b1-9d20-3359828139b3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:47.180756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:47.182280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:47.182563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:47.182837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] PATH_INFO: `/v3/users/83ad65894cf944c79471c899e6293a14` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:47.184033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] RBAC: Authorizing `identity:get_user(user_id=83ad65894cf944c79471c899e6293a14)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:47.185476 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:47.187150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 129/260] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:46 2022] GET /identity/v3/users/83ad65894cf944c79471c899e6293a14 => generated 297 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:47.188482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:47.259183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:47.260045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:47.261759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:47.262048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:47.264904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:47.268325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:47.275611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 132/261] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:46 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:47.276613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:47.393454 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5689d6-5b9f-42e4-b8d5-b5477666f02c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:47.448996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:47.449664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:47.449951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:47.450239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:47.450984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:47.451288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:47.455128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:47.472172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 130/262] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:24:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:47.473055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:47.506490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26f7e2-0c23-4fd0-bd51-f4c1b35f5537 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:47.514139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:47.557705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:47.558596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:47.558880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:47.559157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:47.561811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:47.563346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:47.575040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 133/263] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:47 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:47.575958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:47.618678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:47.690807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a076-fe41-468e-8648-6b3a07a2df8c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:47.749323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f64e92-7e4d-477c-a5f8-aeb6b04f8b58 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:47.752269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:47.752927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:47.753213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:47.753489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:47.754341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=7a1a9ebed8d04349930156ab90dcb9f8) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:47.754655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:47.756116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:47.768843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 131/264] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:47 2022] GET /identity/v3/role_assignments?user.id=7a1a9ebed8d04349930156ab90dcb9f8&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:47.769656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:47.820354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:47.821253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:47.821536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:47.821812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] PATH_INFO: `/v3/users/7a1a9ebed8d04349930156ab90dcb9f8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:47.823930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] RBAC: Authorizing `identity:get_user(user_id=7a1a9ebed8d04349930156ab90dcb9f8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:47.825406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:47.829456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 134/265] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:47 2022] GET /identity/v3/users/7a1a9ebed8d04349930156ab90dcb9f8 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:47.834483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:47.940347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:47.990499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49582fd-03a6-406c-87a5-4ebf2c63802c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:48.010238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:48.030144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4deb5-2266-4398-b015-6a595ed9958d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:48.092822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7d88-c1ef-4a55-9ca9-fe24d6dd8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:48.094158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7d88-c1ef-4a55-9ca9-fe24d6dd8fbc None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.094673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7d88-c1ef-4a55-9ca9-fe24d6dd8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.095171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7d88-c1ef-4a55-9ca9-fe24d6dd8fbc None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/83ad65894cf944c79471c899e6293a14/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.099698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7d88-c1ef-4a55-9ca9-fe24d6dd8fbc None admin] RBAC: Authorizing `identity:create_grant(project_id=27fd3f52f375402f8263c68266fcd5f0, user_id=83ad65894cf944c79471c899e6293a14, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:48.101400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7d88-c1ef-4a55-9ca9-fe24d6dd8fbc None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:48.113227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a49c95-26f4-4ef2-a2bc-ba18c3a5de47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:48.114256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49c95-26f4-4ef2-a2bc-ba18c3a5de47 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.114812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49c95-26f4-4ef2-a2bc-ba18c3a5de47 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.115287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49c95-26f4-4ef2-a2bc-ba18c3a5de47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.186905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 132/266] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:47 2022] PUT /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/83ad65894cf944c79471c899e6293a14/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:48.189218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f645-5a30-4a7e-b69e-b616a630a5ed None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.189578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f645-5a30-4a7e-b69e-b616a630a5ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.189934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f645-5a30-4a7e-b69e-b616a630a5ed None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.191745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 133/267] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:48.201896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4269-3a46-46cb-99bc-a9d2a4f8496f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.202345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4269-3a46-46cb-99bc-a9d2a4f8496f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.202714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4269-3a46-46cb-99bc-a9d2a4f8496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.217215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a49c95-26f4-4ef2-a2bc-ba18c3a5de47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:48.222283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a49c95-26f4-4ef2-a2bc-ba18c3a5de47 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:48.249558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a8ee4269-3a46-46cb-99bc-a9d2a4f8496f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:48.250993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a8ee4269-3a46-46cb-99bc-a9d2a4f8496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:48.350411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:48.369396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 135/268] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:48.372563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016ed70-8a33-40d5-84bd-bb40a99ae654 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.372563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016ed70-8a33-40d5-84bd-bb40a99ae654 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.372563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016ed70-8a33-40d5-84bd-bb40a99ae654 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.372842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 136/269] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:48.376784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016ed70-8a33-40d5-84bd-bb40a99ae654 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:48.384737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 134/270] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:48.386574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e75f9-5709-43c6-986c-f19808b5802b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.387081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e75f9-5709-43c6-986c-f19808b5802b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.387555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e75f9-5709-43c6-986c-f19808b5802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.413981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4a9e75f9-5709-43c6-986c-f19808b5802b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:48.415316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4a9e75f9-5709-43c6-986c-f19808b5802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:48.505308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:48.512761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 135/271] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:48.513754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e75f9-5709-43c6-986c-f19808b5802b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:48.517662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016ed70-8a33-40d5-84bd-bb40a99ae654 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:48.562864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:48.564141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.564668 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.565148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.567118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:48.569916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:48.572335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 137/272] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:48 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:48.578234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:48.641815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e75f9-5709-43c6-986c-f19808b5802b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:48.645871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:48.682636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:48.683841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.684328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.684898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.702540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:48.711783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:48.712721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:48.713501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 136/273] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:48.714658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:48.716055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6c82-091f-4135-91e2-2018f563cad8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:48.761895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:48.763111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.763396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.763672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.765043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:48.766676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:48.773271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 138/274] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:48.774157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:48.788555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:48.848182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eb743-c7ec-4c0e-a979-12682573f7ed None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:48.885593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507bb3a-827e-477b-ba8a-7876a237d8e0 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:48.888348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:48.889000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.889286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.889565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.890457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] RBAC: Adding query filter params (role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=7a1a9ebed8d04349930156ab90dcb9f8) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:48.890773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:48.892243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:48.898533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 137/275] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:48 2022] GET /identity/v3/role_assignments?user.id=7a1a9ebed8d04349930156ab90dcb9f8&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:48.906730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:48.931258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:48.937837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ed7f1-a4c6-47ca-af18-35e1eb9846b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:48.938663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed7f1-a4c6-47ca-af18-35e1eb9846b3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.939875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed7f1-a4c6-47ca-af18-35e1eb9846b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.944904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed7f1-a4c6-47ca-af18-35e1eb9846b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.944904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed7f1-a4c6-47ca-af18-35e1eb9846b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:48.944904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed7f1-a4c6-47ca-af18-35e1eb9846b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:48.944904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed7f1-a4c6-47ca-af18-35e1eb9846b3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:48.954821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 139/276] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:48.956278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2a751-8987-45a8-bc95-3fa12f328a26 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:48.956944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2a751-8987-45a8-bc95-3fa12f328a26 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:48.957321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2a751-8987-45a8-bc95-3fa12f328a26 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:48.959215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 140/277] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:48.960090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2a751-8987-45a8-bc95-3fa12f328a26 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:49.021446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7876270-3860-43ec-84c3-461587d3eab1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:49.051268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:49.064489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:49.065220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:49.065754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:49.066030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:49.066796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:49.068317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:49.097158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2a751-8987-45a8-bc95-3fa12f328a26 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:49.141867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca690-7f68-4787-8501-92825109e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:49.142910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca690-7f68-4787-8501-92825109e168 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:49.143198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca690-7f68-4787-8501-92825109e168 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:49.143475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca690-7f68-4787-8501-92825109e168 None admin] PATH_INFO: `/v3/users/f6ed055dc128440aac29b2eeaad138fb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:49.159989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca690-7f68-4787-8501-92825109e168 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ed055dc128440aac29b2eeaad138fb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:49.161465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca690-7f68-4787-8501-92825109e168 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:49.163486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 141/278] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:48 2022] GET /identity/v3/users/f6ed055dc128440aac29b2eeaad138fb => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:49.164583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e492-6527-4ba9-ba90-4d06f3dc7a89 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:49.164877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e492-6527-4ba9-ba90-4d06f3dc7a89 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:49.165153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e492-6527-4ba9-ba90-4d06f3dc7a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:49.178934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 138/279] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:24:48 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:49.180319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:49.181913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b7b3e492-6527-4ba9-ba90-4d06f3dc7a89 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:49.183016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b7b3e492-6527-4ba9-ba90-4d06f3dc7a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:49.249301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:49.294676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 142/280] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:49.327543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e492-6527-4ba9-ba90-4d06f3dc7a89 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:49.339330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca2a61-2dbd-482f-8b9c-4215699d205b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:49.383401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:49.384410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:49.384897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:49.385380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:49.386604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, user.id=f6ed055dc128440aac29b2eeaad138fb, scope.system=all) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:49.387145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:49.388972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:49.395596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 139/281] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 19 21:24:49 2022] GET /identity/v3/role_assignments?user.id=f6ed055dc128440aac29b2eeaad138fb&scope.system=all&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:49.471926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e492-6527-4ba9-ba90-4d06f3dc7a89 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:49.513548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:49.514403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:49.514689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:49.514966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:49.527696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:49.535875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:49.536777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:49.537578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 143/282] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:49.544785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:49.608528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:49.667418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaffe4-46fa-48ba-949a-d33b180c6d56 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:49.703271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:49.704664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:49.705129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:49.705593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:49.706560 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:49.707047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:49.708633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:49.717928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 140/283] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:49.724475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:49.769638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:49.843366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939afa00-d24a-426a-92ab-6b4be2453476 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:49.889710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:49.890888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:49.891173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:49.891462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] PATH_INFO: `/v3/users/5e7c6ef01a0149d18bbdb917a6017463` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:49.892685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] RBAC: Authorizing `identity:get_user(user_id=5e7c6ef01a0149d18bbdb917a6017463)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:49.894143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:49.895806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 144/284] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:49 2022] GET /identity/v3/users/5e7c6ef01a0149d18bbdb917a6017463 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:49.901345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:50.028087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1555d-90da-4e82-8aee-ebe494098c78 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:50.040178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:50.075871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80fb98-3472-48d3-a9c1-331a22ff5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:50.077168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80fb98-3472-48d3-a9c1-331a22ff5b26 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:50.077654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80fb98-3472-48d3-a9c1-331a22ff5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:50.078756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80fb98-3472-48d3-a9c1-331a22ff5b26 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:50.082475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80fb98-3472-48d3-a9c1-331a22ff5b26 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:50.084150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80fb98-3472-48d3-a9c1-331a22ff5b26 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:50.086086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 141/285] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:49 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:50.091833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:50.258604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e1b6c-28be-478d-8103-037076439f0d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:50.268643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:50.306386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f4285-0f7d-4332-b46a-21dcc5966c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:50.307281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f4285-0f7d-4332-b46a-21dcc5966c3d None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:50.307560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f4285-0f7d-4332-b46a-21dcc5966c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:50.307836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f4285-0f7d-4332-b46a-21dcc5966c3d None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/5e7c6ef01a0149d18bbdb917a6017463/roles/f52e0f4285db4c30ab63860a4fc840b1` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:50.311645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f4285-0f7d-4332-b46a-21dcc5966c3d None admin] RBAC: Authorizing `identity:create_grant(project_id=27fd3f52f375402f8263c68266fcd5f0, user_id=5e7c6ef01a0149d18bbdb917a6017463, role_id=f52e0f4285db4c30ab63860a4fc840b1)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:50.313670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f4285-0f7d-4332-b46a-21dcc5966c3d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:50.391269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 145/286] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:24:50 2022] PUT /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0/users/5e7c6ef01a0149d18bbdb917a6017463/roles/f52e0f4285db4c30ab63860a4fc840b1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:50.635719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d748e-5a43-4442-8027-0286343d3ba5 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:50.636118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d748e-5a43-4442-8027-0286343d3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:50.636321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d748e-5a43-4442-8027-0286343d3ba5 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:50.638048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 142/287] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:50.643997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8e56-4f80-4c7e-ac67-dde38055ffcd None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:50.644468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8e56-4f80-4c7e-ac67-dde38055ffcd None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:50.644540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8e56-4f80-4c7e-ac67-dde38055ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:50.668041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-f57c8e56-4f80-4c7e-ac67-dde38055ffcd None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:50.669244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f57c8e56-4f80-4c7e-ac67-dde38055ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:50.753903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 146/288] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:50.781960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d748e-5a43-4442-8027-0286343d3ba5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:50.923234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d748e-5a43-4442-8027-0286343d3ba5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:50.963567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:50.964371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:50.964654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:50.964932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:50.975314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:50.983052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:50.983993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:50.984846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 143/289] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:50.995425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8e56-4f80-4c7e-ac67-dde38055ffcd None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:51.176611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:51.182255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8e56-4f80-4c7e-ac67-dde38055ffcd None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:51.228106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:51.228782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:51.229065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:51.229344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:51.230089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:51.230421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:51.231820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:51.245298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 147/290] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:51.251085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:51.317608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:51.385146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c781-ad32-4db4-9773-4020d66f421f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:51.435931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:51.436726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:51.437009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:51.437327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] PATH_INFO: `/v3/users/83ad65894cf944c79471c899e6293a14` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:51.438559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] RBAC: Authorizing `identity:get_user(user_id=83ad65894cf944c79471c899e6293a14)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:51.440011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:51.442069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 144/291] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:51 2022] GET /identity/v3/users/83ad65894cf944c79471c899e6293a14 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:51.447677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:51.606529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc5e1-276c-449c-8114-439a4390aeb1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:51.656869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:51.657521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:51.657795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:51.658074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:51.699112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:51.761724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:51.763219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:51.892343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 148/292] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:51.898166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.063473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c640-b17f-4d8c-9e84-2ae989c1b171 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:52.068083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:52.113658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a8a6b-2df2-469f-aa00-98ccd95ceb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:52.119370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a8a6b-2df2-469f-aa00-98ccd95ceb4e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.119654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a8a6b-2df2-469f-aa00-98ccd95ceb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.119938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a8a6b-2df2-469f-aa00-98ccd95ceb4e None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.121326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a8a6b-2df2-469f-aa00-98ccd95ceb4e None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:52.122856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a8a6b-2df2-469f-aa00-98ccd95ceb4e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:52.125454 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 145/293] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:51 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:52.131065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.157028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a136a-2601-4a8c-baa6-d6f6da6d23a3 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.157307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a136a-2601-4a8c-baa6-d6f6da6d23a3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.157610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a136a-2601-4a8c-baa6-d6f6da6d23a3 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.159488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 146/294] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:52.168162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd101e7c-97fe-43d3-a9b1-501f200d6574 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.168952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd101e7c-97fe-43d3-a9b1-501f200d6574 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.169743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd101e7c-97fe-43d3-a9b1-501f200d6574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.209158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bd101e7c-97fe-43d3-a9b1-501f200d6574 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:52.212156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bd101e7c-97fe-43d3-a9b1-501f200d6574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:52.239454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:52.285148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd58fa-7daf-420e-8582-7f6dafcf0b22 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:52.328293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023469f3-8a28-48fe-8d49-0e20c1360182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:52.329180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023469f3-8a28-48fe-8d49-0e20c1360182 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.329619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023469f3-8a28-48fe-8d49-0e20c1360182 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.330033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023469f3-8a28-48fe-8d49-0e20c1360182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.331468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023469f3-8a28-48fe-8d49-0e20c1360182 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=83ad65894cf944c79471c899e6293a14) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:52.332202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023469f3-8a28-48fe-8d49-0e20c1360182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:52.334283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023469f3-8a28-48fe-8d49-0e20c1360182 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:52.343515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 149/295] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:52 2022] GET /identity/v3/role_assignments?user.id=83ad65894cf944c79471c899e6293a14&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:52.344916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1769-eb90-4dc6-a276-0fe5664089f6 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.345369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1769-eb90-4dc6-a276-0fe5664089f6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.345787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1769-eb90-4dc6-a276-0fe5664089f6 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.347213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 150/296] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:52.351528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b2b-9d28-42e5-81ca-f5ed52c0b2f0 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.352022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b2b-9d28-42e5-81ca-f5ed52c0b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.352471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b2b-9d28-42e5-81ca-f5ed52c0b2f0 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.352839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 147/297] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:52.354590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 151/298] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:52.364354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca923c-9e4c-4c11-952c-df679edfcc22 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.364547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b22ed-931c-4512-8094-9a8c2daa5fcc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.364712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b22ed-931c-4512-8094-9a8c2daa5fcc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.365002 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b22ed-931c-4512-8094-9a8c2daa5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.365283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca923c-9e4c-4c11-952c-df679edfcc22 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.365701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca923c-9e4c-4c11-952c-df679edfcc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.391202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b61b22ed-931c-4512-8094-9a8c2daa5fcc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:52.391598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c5ca923c-9e4c-4c11-952c-df679edfcc22 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:52.392827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c5ca923c-9e4c-4c11-952c-df679edfcc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:52.392943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b61b22ed-931c-4512-8094-9a8c2daa5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:52.478432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 152/299] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:52.479614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca923c-9e4c-4c11-952c-df679edfcc22 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.494284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 148/300] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:52.505034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b22ed-931c-4512-8094-9a8c2daa5fcc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.549270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:52.559874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:52.625393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca923c-9e4c-4c11-952c-df679edfcc22 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:52.641490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b22ed-931c-4512-8094-9a8c2daa5fcc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:52.668209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:52.669056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.669338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.669608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.678704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:52.679492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.679769 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.680040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.680512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:52.688435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:52.689296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 153/301] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:52.691263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.695054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:52.702779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:52.703627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:52.704399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 149/302] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:52.705958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.817472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:52.818393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b40c60-0f1d-4a34-98e0-e788371923ca None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:52.827738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e227a-a774-4969-b295-2920d2e16998 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:52.830940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:52.852283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:52.853133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.853415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.853728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.854901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:52.856347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:52.857987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 154/303] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:52.858776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.867365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:52.868785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:52.869254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:52.869698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:52.871014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:52.873847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:52.873847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:52.887834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 150/304] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:52.887834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:52.974378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17730585-b9a1-436d-a49c-d5923c449d25 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:52.987964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677354b-5f16-4fe3-a93d-a21f86e35c59 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:53.017619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.018562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.018996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.019420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.020359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:53.020822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:53.022447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:53.022790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.023454 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.023736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.024012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] PATH_INFO: `/v3/groups` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.024689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:53.026113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:53.032437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 155/305] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:53.037080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:53.083228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:53.097275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 151/306] 10.222.0.59 () {60 vars in 1134 bytes} [Thu May 19 21:24:52 2022] POST /identity/v3/groups => generated 229 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:53.098547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:53.134618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:53.173577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca3bb-9285-44f1-90d1-b794d25e618f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:53.217435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.219238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.219696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.220138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] PATH_INFO: `/v3/users/f6ed055dc128440aac29b2eeaad138fb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.221561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ed055dc128440aac29b2eeaad138fb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:53.223293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:53.225335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 156/307] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:53 2022] GET /identity/v3/users/f6ed055dc128440aac29b2eeaad138fb => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:53.235617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:53.264375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8e0a-8925-402c-a523-286d0737a3a7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:53.303846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa740d4-6b29-4ed8-9f6f-5b80c27a8d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.304843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa740d4-6b29-4ed8-9f6f-5b80c27a8d35 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.305131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa740d4-6b29-4ed8-9f6f-5b80c27a8d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.305433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa740d4-6b29-4ed8-9f6f-5b80c27a8d35 None admin] PATH_INFO: `/v3/users/416a8e6b151d4ab3accfe0fd8b3e3ddc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.319996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa740d4-6b29-4ed8-9f6f-5b80c27a8d35 None admin] RBAC: Authorizing `identity:get_user(user_id=416a8e6b151d4ab3accfe0fd8b3e3ddc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:53.322342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa740d4-6b29-4ed8-9f6f-5b80c27a8d35 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:53.323622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 152/308] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:53 2022] GET /identity/v3/users/416a8e6b151d4ab3accfe0fd8b3e3ddc => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:53.324994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713580a-234e-475c-9c41-cdc9a5d0db60 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.325286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713580a-234e-475c-9c41-cdc9a5d0db60 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.325568 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713580a-234e-475c-9c41-cdc9a5d0db60 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.326837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 153/309] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:53.328994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713580a-234e-475c-9c41-cdc9a5d0db60 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:53.361132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204faaa-5de6-4ff6-9509-f3eb753d5746 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:53.374357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:53.404937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.406554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.407010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.407644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] PATH_INFO: `/v3/system/users/f6ed055dc128440aac29b2eeaad138fb/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.409256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f6ed055dc128440aac29b2eeaad138fb, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:53.410780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:53.413203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:53.445113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713580a-234e-475c-9c41-cdc9a5d0db60 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:53.479146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9de58-679f-421e-a93a-acecfd98ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.479790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9de58-679f-421e-a93a-acecfd98ae00 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.480071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9de58-679f-421e-a93a-acecfd98ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.480344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9de58-679f-421e-a93a-acecfd98ae00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.481158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9de58-679f-421e-a93a-acecfd98ae00 None admin] RBAC: Adding query filter params (role.id=f52e0f4285db4c30ab63860a4fc840b1, user.id=416a8e6b151d4ab3accfe0fd8b3e3ddc, scope.system=all) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:53.481469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9de58-679f-421e-a93a-acecfd98ae00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:53.482984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9de58-679f-421e-a93a-acecfd98ae00 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:53.487914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 154/310] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 19 21:24:53 2022] GET /identity/v3/role_assignments?user.id=416a8e6b151d4ab3accfe0fd8b3e3ddc&scope.system=all&role.id=f52e0f4285db4c30ab63860a4fc840b1 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:53.487914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170430a4-20e7-40c9-99e7-2333643e2ee5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.487914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170430a4-20e7-40c9-99e7-2333643e2ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.487914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170430a4-20e7-40c9-99e7-2333643e2ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.517442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-170430a4-20e7-40c9-99e7-2333643e2ee5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:53.518701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-170430a4-20e7-40c9-99e7-2333643e2ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:53.537171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 157/311] 10.222.0.59 () {58 vars in 1334 bytes} [Thu May 19 21:24:53 2022] PUT /identity/v3/system/users/f6ed055dc128440aac29b2eeaad138fb/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:24:53.604336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 155/312] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:53.629374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:53.753013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f90f0-ad60-463b-8974-0dda82669ab8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:53.789784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.790630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.790914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.791191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.802550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:53.810501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:53.811385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:53.812803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 158/313] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:53.818598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170430a4-20e7-40c9-99e7-2333643e2ee5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:53.881706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:53.920801 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170430a4-20e7-40c9-99e7-2333643e2ee5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:53.958073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:53.958779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:53.959066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:53.959346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:53.960094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:53.960403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:53.961786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:53.971359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 156/314] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:53.976539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:54.014343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:54.082796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eac8c4-4690-45d4-a9de-8bce85284d16 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:54.118296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:54.119225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:54.119509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:54.119833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] PATH_INFO: `/v3/users/5e7c6ef01a0149d18bbdb917a6017463` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:54.121028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] RBAC: Authorizing `identity:get_user(user_id=5e7c6ef01a0149d18bbdb917a6017463)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:54.122494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:54.124460 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 159/315] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:53 2022] GET /identity/v3/users/5e7c6ef01a0149d18bbdb917a6017463 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:54.129857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:54.244292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129b8fa-8c4c-47fc-89b8-11f6ae37c331 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:54.271820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:54.290622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:54.291270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:54.291552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:54.291877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:54.364334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:54.365881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:54.469843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 157/316] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:24:54.475524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:54.576833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ad0f5-c247-46e9-99e3-5ba67e0b914e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:54.578759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:54.610762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ebd1-796a-4799-a554-5c28da6bc5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:54.611618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ebd1-796a-4799-a554-5c28da6bc5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:54.611904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ebd1-796a-4799-a554-5c28da6bc5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:54.612179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ebd1-796a-4799-a554-5c28da6bc5c5 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:54.613508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ebd1-796a-4799-a554-5c28da6bc5c5 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:54.614966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ebd1-796a-4799-a554-5c28da6bc5c5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:54.617148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 160/317] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:24:54 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:54.622864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:54.650922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:54.726347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624eb6b-1a76-40fc-a8ba-87cfb011e5b0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:54.762747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cceaa6-6014-46f7-9ef6-38c5c94a1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:54.763417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cceaa6-6014-46f7-9ef6-38c5c94a1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:54.763700 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cceaa6-6014-46f7-9ef6-38c5c94a1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:54.763977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cceaa6-6014-46f7-9ef6-38c5c94a1ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:54.764816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cceaa6-6014-46f7-9ef6-38c5c94a1ff2 None admin] RBAC: Adding query filter params (role.id=f52e0f4285db4c30ab63860a4fc840b1, scope.project.id=27fd3f52f375402f8263c68266fcd5f0, user.id=5e7c6ef01a0149d18bbdb917a6017463) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:54.765162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cceaa6-6014-46f7-9ef6-38c5c94a1ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:54.766709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cceaa6-6014-46f7-9ef6-38c5c94a1ff2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:54.775079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 158/318] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:24:54 2022] GET /identity/v3/role_assignments?user.id=5e7c6ef01a0149d18bbdb917a6017463&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=f52e0f4285db4c30ab63860a4fc840b1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:55.445945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150d6aa-a63d-425e-9fb0-f401f4112fac None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:55.446516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150d6aa-a63d-425e-9fb0-f401f4112fac None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:55.446516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150d6aa-a63d-425e-9fb0-f401f4112fac None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:55.448045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 161/319] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:55.453757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490b0a-d0f0-476e-886e-69300fbb2c96 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:55.454133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490b0a-d0f0-476e-886e-69300fbb2c96 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:55.454337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490b0a-d0f0-476e-886e-69300fbb2c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:55.471490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7e490b0a-d0f0-476e-886e-69300fbb2c96 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:55.472600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7e490b0a-d0f0-476e-886e-69300fbb2c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:55.540881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 159/320] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:55.563754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150d6aa-a63d-425e-9fb0-f401f4112fac None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:55.666092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150d6aa-a63d-425e-9fb0-f401f4112fac None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:55.699267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c49b6-bbb1-43d3-9ca4-a253328e3e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:55.700054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c49b6-bbb1-43d3-9ca4-a253328e3e78 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:55.700341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c49b6-bbb1-43d3-9ca4-a253328e3e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:55.700618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c49b6-bbb1-43d3-9ca4-a253328e3e78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:55.701770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c49b6-bbb1-43d3-9ca4-a253328e3e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:55.703270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c49b6-bbb1-43d3-9ca4-a253328e3e78 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:55.705021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 162/321] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:55.710457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e490b0a-d0f0-476e-886e-69300fbb2c96 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:55.732136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:55.817878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e490b0a-d0f0-476e-886e-69300fbb2c96 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:55.855334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8882-c050-44c5-908f-0b45bde42bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:55.856003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8882-c050-44c5-908f-0b45bde42bbe None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:55.856284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8882-c050-44c5-908f-0b45bde42bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:55.856559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8882-c050-44c5-908f-0b45bde42bbe None admin] PATH_INFO: `/v3/groups` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:55.857262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8882-c050-44c5-908f-0b45bde42bbe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:55.859284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8882-c050-44c5-908f-0b45bde42bbe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:55.935969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ff63f-e0e0-49c1-ab46-b9376f384251 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:55.936259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ff63f-e0e0-49c1-ab46-b9376f384251 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:55.936540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ff63f-e0e0-49c1-ab46-b9376f384251 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:55.938661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 163/322] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:55.943854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fdbd-f31a-42f0-949d-ae0ca8bb9457 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:55.944146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fdbd-f31a-42f0-949d-ae0ca8bb9457 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:55.944429 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fdbd-f31a-42f0-949d-ae0ca8bb9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:55.961281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1ec8fdbd-f31a-42f0-949d-ae0ca8bb9457 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:55.970489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 160/323] 10.222.0.59 () {60 vars in 1134 bytes} [Thu May 19 21:24:55 2022] POST /identity/v3/groups => generated 226 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:24:55.970690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1ec8fdbd-f31a-42f0-949d-ae0ca8bb9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:56.004071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:56.014387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da446b9-791c-4f9f-9dfe-f3a99838cd5a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.014686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da446b9-791c-4f9f-9dfe-f3a99838cd5a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.017415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da446b9-791c-4f9f-9dfe-f3a99838cd5a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.017415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 161/324] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:56.022290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3351b-493b-4317-9cfa-7663a81a2cce None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.022593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3351b-493b-4317-9cfa-7663a81a2cce None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.022874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3351b-493b-4317-9cfa-7663a81a2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.040553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-45b3351b-493b-4317-9cfa-7663a81a2cce None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:56.041792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-45b3351b-493b-4317-9cfa-7663a81a2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:56.045461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 164/325] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:56.069599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8fdbd-f31a-42f0-949d-ae0ca8bb9457 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.142352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 162/326] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:24:56.156782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3351b-493b-4317-9cfa-7663a81a2cce None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.170140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:56.193677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8fdbd-f31a-42f0-949d-ae0ca8bb9457 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.237833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.238935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.239371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.239642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.253475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:56.262168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:56.263134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:24:56.263915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:56.264650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 165/327] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:24:56.271067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.293091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3351b-493b-4317-9cfa-7663a81a2cce None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.309337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:56.334937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.335730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.336016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.336295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.350450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:56.360065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:56.360969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:24:56.361749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 163/328] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:24:56.367527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.403787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c77c8-cf53-4f06-95ff-d97ab5f73731 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.453861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.454832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.455118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.455814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.456573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:56.456882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:56.458690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:56.468068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:56.473630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 166/329] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:56.479285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.507721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca873-483d-4764-a23d-b501b812a24a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.566295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.566980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.567271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.567554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.568319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:56.568631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:56.570026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:56.581327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 164/330] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:56.588022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.603493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:56.614184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468f0ae-dbc5-458f-b61c-86ca8f7b6d9b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.650967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.651848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.652130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.652404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] PATH_INFO: `/v3/users/416a8e6b151d4ab3accfe0fd8b3e3ddc` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.653648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] RBAC: Authorizing `identity:get_user(user_id=416a8e6b151d4ab3accfe0fd8b3e3ddc)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:56.655174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:56.657510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 167/331] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:56 2022] GET /identity/v3/users/416a8e6b151d4ab3accfe0fd8b3e3ddc => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:56.662529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.709996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58e052-f577-415c-8e1d-8ae1bec2e99b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.748258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:56.754994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.755873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.756167 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.756439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] PATH_INFO: `/v3/users/f6ed055dc128440aac29b2eeaad138fb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.757835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] RBAC: Authorizing `identity:get_user(user_id=f6ed055dc128440aac29b2eeaad138fb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:56.759372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:56.763791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 165/332] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:24:56 2022] GET /identity/v3/users/f6ed055dc128440aac29b2eeaad138fb => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:56.769974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:56.789509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8bdd-ff19-4d15-94e0-0f9ae71e2e50 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.843309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1bc7b-b004-4f3f-834c-5b433ced54d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.843751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bc7b-b004-4f3f-834c-5b433ced54d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.844035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bc7b-b004-4f3f-834c-5b433ced54d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.844312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bc7b-b004-4f3f-834c-5b433ced54d3 None admin] PATH_INFO: `/v3/system/users/416a8e6b151d4ab3accfe0fd8b3e3ddc/roles/f52e0f4285db4c30ab63860a4fc840b1` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.846516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1bc7b-b004-4f3f-834c-5b433ced54d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=416a8e6b151d4ab3accfe0fd8b3e3ddc, role_id=f52e0f4285db4c30ab63860a4fc840b1)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:56.847913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1bc7b-b004-4f3f-834c-5b433ced54d3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:56.904232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651ce7d-3d99-4d2f-a1c3-2378fdf3d21f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:56.931672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 168/333] 10.222.0.59 () {58 vars in 1334 bytes} [Thu May 19 21:24:56 2022] PUT /identity/v3/system/users/416a8e6b151d4ab3accfe0fd8b3e3ddc/roles/f52e0f4285db4c30ab63860a4fc840b1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:24:56.948714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f892d7-1346-4d28-a832-e2fa493fa843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:56.949376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f892d7-1346-4d28-a832-e2fa493fa843 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:56.949667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f892d7-1346-4d28-a832-e2fa493fa843 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:56.949950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f892d7-1346-4d28-a832-e2fa493fa843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:56.950808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f892d7-1346-4d28-a832-e2fa493fa843 None admin] RBAC: Adding query filter params (role.id=2e1a7d8a55ac4d66b5464eafdab93afb, user.id=f6ed055dc128440aac29b2eeaad138fb, scope.system=all) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:56.951128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f892d7-1346-4d28-a832-e2fa493fa843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:56.952721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f892d7-1346-4d28-a832-e2fa493fa843 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:56.966680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 166/334] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 19 21:24:56 2022] GET /identity/v3/role_assignments?user.id=f6ed055dc128440aac29b2eeaad138fb&scope.system=all&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:24:59.091923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156e850-2af4-42d4-8b8b-3207cb3426f7 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:59.092485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156e850-2af4-42d4-8b8b-3207cb3426f7 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:59.092485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156e850-2af4-42d4-8b8b-3207cb3426f7 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:59.094849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 169/335] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:24:59.107813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39afefc-b6f2-4fe4-9b6b-4c1cbd279d05 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:59.108286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39afefc-b6f2-4fe4-9b6b-4c1cbd279d05 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:59.108368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39afefc-b6f2-4fe4-9b6b-4c1cbd279d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:59.135314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e39afefc-b6f2-4fe4-9b6b-4c1cbd279d05 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:59.136505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e39afefc-b6f2-4fe4-9b6b-4c1cbd279d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:59.201274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:59.216305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 167/336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:24:59.253485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156e850-2af4-42d4-8b8b-3207cb3426f7 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:59.282050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:59.382887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156e850-2af4-42d4-8b8b-3207cb3426f7 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:59.431125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:59.431924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:59.432211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:59.432480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:59.447427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:24:59.455867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:24:59.456817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:24:59.461366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:24:59.466053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 170/337] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:24:59.466290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39afefc-b6f2-4fe4-9b6b-4c1cbd279d05 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:59.591310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39afefc-b6f2-4fe4-9b6b-4c1cbd279d05 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:59.638022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63520e58-7655-4683-b0bc-a7a5f05e041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:59.638645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520e58-7655-4683-b0bc-a7a5f05e041c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:59.638925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520e58-7655-4683-b0bc-a7a5f05e041c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:59.639196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520e58-7655-4683-b0bc-a7a5f05e041c None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:59.639987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63520e58-7655-4683-b0bc-a7a5f05e041c None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:24:59.640292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63520e58-7655-4683-b0bc-a7a5f05e041c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:59.641691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63520e58-7655-4683-b0bc-a7a5f05e041c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:59.656092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 168/338] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:24:59.661249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:24:59.753178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:59.771573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138876e6-693b-4c98-b89c-13abf4f6bbfb None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:24:59.806892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:24:59.807543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:59.807824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:59.808100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:59.839523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a256-1e53-453e-b104-33aba85fcf18 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:59.839838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a256-1e53-453e-b104-33aba85fcf18 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:59.840070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a256-1e53-453e-b104-33aba85fcf18 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:59.841585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 169/339] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:24:59.847714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba580c9-5e10-42fe-9a47-cf69d17139d0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:24:59.848215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba580c9-5e10-42fe-9a47-cf69d17139d0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:24:59.848643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba580c9-5e10-42fe-9a47-cf69d17139d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:24:59.882237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cba580c9-5e10-42fe-9a47-cf69d17139d0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:24:59.884521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cba580c9-5e10-42fe-9a47-cf69d17139d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:24:59.967739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:24:59.969806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:24:59.990626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:00.009676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 170/340] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:00.011812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61289c37-0e37-4197-9074-bc369ca7601f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.019107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61289c37-0e37-4197-9074-bc369ca7601f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.019107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61289c37-0e37-4197-9074-bc369ca7601f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.019107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 171/341] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:00.022059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4b61-cd60-4a4a-92bc-3544a2c2fcf5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.022388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4b61-cd60-4a4a-92bc-3544a2c2fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.022671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4b61-cd60-4a4a-92bc-3544a2c2fcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.047442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c4be4b61-cd60-4a4a-92bc-3544a2c2fcf5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:00.051185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c4be4b61-cd60-4a4a-92bc-3544a2c2fcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:00.146608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:00.169475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 171/342] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:00.170370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:00.194010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 172/343] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:25:00.195893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50015a9-c350-4002-b912-5075770d6985 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.196190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50015a9-c350-4002-b912-5075770d6985 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.196472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50015a9-c350-4002-b912-5075770d6985 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.198865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 173/344] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:00.199706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50015a9-c350-4002-b912-5075770d6985 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:00.303491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f7e2a-29c0-45bc-9e98-57e4044ac02c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:00.329867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50015a9-c350-4002-b912-5075770d6985 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:00.339121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecdedc-23d3-441e-bd1c-a71384933831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:00.339915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecdedc-23d3-441e-bd1c-a71384933831 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.340193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecdedc-23d3-441e-bd1c-a71384933831 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.340460 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecdedc-23d3-441e-bd1c-a71384933831 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.342126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:00.352019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecdedc-23d3-441e-bd1c-a71384933831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-05ecdedc-23d3-441e-bd1c-a71384933831 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:00.365898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:00.367120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:00.368043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 172/345] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:00.368739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71287cee-d3c8-4e92-b1ab-ba0e0bf9f3eb None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.368867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71287cee-d3c8-4e92-b1ab-ba0e0bf9f3eb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.369146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71287cee-d3c8-4e92-b1ab-ba0e0bf9f3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.373803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:00.375444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.375892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.376322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.377677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:00.379319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:00.381187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 174/346] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:00.382117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:00.388350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-71287cee-d3c8-4e92-b1ab-ba0e0bf9f3eb None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:00.389535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-71287cee-d3c8-4e92-b1ab-ba0e0bf9f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:00.438665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:00.472276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 173/347] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:00.474498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71287cee-d3c8-4e92-b1ab-ba0e0bf9f3eb None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:00.501443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ee67-fd7a-4420-8fa4-60ac7e57a503 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:00.548493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:00.549818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.550260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.550888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.566902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:00.575103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:00.576109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:00.576916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:00.579552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 175/348] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:00.580705 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:00.599165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71287cee-d3c8-4e92-b1ab-ba0e0bf9f3eb None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:00.636332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:00.640162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646a96c-cb4e-4b06-81c2-0a4f4191ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:00.640629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a96c-cb4e-4b06-81c2-0a4f4191ae10 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.640978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a96c-cb4e-4b06-81c2-0a4f4191ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.641319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a96c-cb4e-4b06-81c2-0a4f4191ae10 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.642062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646a96c-cb4e-4b06-81c2-0a4f4191ae10 None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:00.642397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646a96c-cb4e-4b06-81c2-0a4f4191ae10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:00.643825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646a96c-cb4e-4b06-81c2-0a4f4191ae10 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:00.654072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 174/349] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:00.656265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27876c96-37d4-4975-8ce7-5cf77c670edc None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.656613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27876c96-37d4-4975-8ce7-5cf77c670edc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.656956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27876c96-37d4-4975-8ce7-5cf77c670edc None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.658288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 175/350] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:00.659097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27876c96-37d4-4975-8ce7-5cf77c670edc None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:00.707215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:00.723768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aa762-86a0-4226-9982-3cd147f0a887 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:00.773247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:00.774109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.774475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.774756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.782994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:00.784473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:00.786147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 176/351] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:00.786935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:00.796978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27876c96-37d4-4975-8ce7-5cf77c670edc None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:00.839972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab8e17-57b2-403a-83b6-83bda77e46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:00.840842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab8e17-57b2-403a-83b6-83bda77e46aa None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.841020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab8e17-57b2-403a-83b6-83bda77e46aa None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.841258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab8e17-57b2-403a-83b6-83bda77e46aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.864716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab8e17-57b2-403a-83b6-83bda77e46aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-14ab8e17-57b2-403a-83b6-83bda77e46aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:00.876284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:00.877220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 176/352] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:00.879719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6831d-4127-41e0-88bd-3557c12dc19c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.880441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6831d-4127-41e0-88bd-3557c12dc19c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.880441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6831d-4127-41e0-88bd-3557c12dc19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.901480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a5d6831d-4127-41e0-88bd-3557c12dc19c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:00.902800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a5d6831d-4127-41e0-88bd-3557c12dc19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:00.935307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457405c-5643-43db-8867-f9ee745cdaab None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:00.936002 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:00.988789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:00.989493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:00.989780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:00.990058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:00.990885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:00.991158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:00.991568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 177/353] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:00.992537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:00.992907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6831d-4127-41e0-88bd-3557c12dc19c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.004600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 177/354] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:01.005450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.022028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:01.111639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6831d-4127-41e0-88bd-3557c12dc19c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:01.129565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab082d-16d0-4a8f-8518-57a102bb6123 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:01.150965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:01.154366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:01.154366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:01.154366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:01.168867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:01.169524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:01.169810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:01.170082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:01.171479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=e8254b1130be4804a04301c20cc1c350) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:01.171814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:01.173261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:01.180146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 178/355] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:01 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:01.180792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.219628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:01.245173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:01.248687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:01.297488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:01.348134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01df3f0-b12c-403d-8b56-95cc4edb5770 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:01.411540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:01.412231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:01.412524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:01.412806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:01.413556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:01.413870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:01.415301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:01.416213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 178/356] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:01.417523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.428258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 179/357] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:25:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:01.429447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.553545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:01.558247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe33157-0030-4d50-83c5-de2af4c360e3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:01.571256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe6d0-8673-4a4d-9161-c58894a14af4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:01.592183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:01.610942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:01.611699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:01.611999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:01.612279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:01.619174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52aac38-10b6-4f3e-b783-9418741a9bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:01.621050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aac38-10b6-4f3e-b783-9418741a9bec None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:01.622406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aac38-10b6-4f3e-b783-9418741a9bec None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:01.622776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aac38-10b6-4f3e-b783-9418741a9bec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:01.635762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52aac38-10b6-4f3e-b783-9418741a9bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f52aac38-10b6-4f3e-b783-9418741a9bec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:01.646153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:01.647172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:01.648018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 180/358] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:01.648678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228935-cc71-4459-8a95-c066be0178b5 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:01.648958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228935-cc71-4459-8a95-c066be0178b5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:01.649232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228935-cc71-4459-8a95-c066be0178b5 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:01.655150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 181/359] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:01.656576 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228935-cc71-4459-8a95-c066be0178b5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.703144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:01.704664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:01.779097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228935-cc71-4459-8a95-c066be0178b5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:01.820089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:01.820709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:01.820998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:01.821280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:01.822988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:01.824558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:01.826333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 182/360] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:01 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:01.827182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.827922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 179/361] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:01.829027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:01.854997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:01.858019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:01.969406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032bf40-2d1d-4ad6-b192-6948bbe1b87e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:01.971898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0d841-fa51-4544-98f0-67bc4b732087 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.022672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea5e0-9839-4b1a-b5c0-94a19f955318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.023408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea5e0-9839-4b1a-b5c0-94a19f955318 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.023688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea5e0-9839-4b1a-b5c0-94a19f955318 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.023962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea5e0-9839-4b1a-b5c0-94a19f955318 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.024713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eea5e0-9839-4b1a-b5c0-94a19f955318 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:02.025022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eea5e0-9839-4b1a-b5c0-94a19f955318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.027047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eea5e0-9839-4b1a-b5c0-94a19f955318 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.032671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.033661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.033942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.034322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] PATH_INFO: `/v3/users/416a8e6b151d4ab3accfe0fd8b3e3ddc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.035464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] RBAC: Authorizing `identity:get_user(user_id=416a8e6b151d4ab3accfe0fd8b3e3ddc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.036537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 180/362] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:02.036910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.037776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3460-1f62-4dae-9767-1e702409103d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.038068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3460-1f62-4dae-9767-1e702409103d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.038382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3460-1f62-4dae-9767-1e702409103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.038560 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 183/363] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:25:01 2022] GET /identity/v3/users/416a8e6b151d4ab3accfe0fd8b3e3ddc => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:02.039309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.060836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-deaa3460-1f62-4dae-9767-1e702409103d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:02.061419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-deaa3460-1f62-4dae-9767-1e702409103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:02.154117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 181/364] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:02.155907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa3460-1f62-4dae-9767-1e702409103d None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.159945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:02.176891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8ef48-31b8-4747-860b-8f1f31337123 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.180596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:02.221463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.222274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.222557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.222826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.224335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.225926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.228876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 184/365] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:02.228876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.320484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa3460-1f62-4dae-9767-1e702409103d None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.369206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273ace-3ef5-4faf-9a0c-77f655cc9a93 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.376241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.376241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.376507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.376796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.378029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.379592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.381230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 182/366] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:02.381995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.409877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.410599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.410899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.411173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.439229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:02.485281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:02.487619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.489094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.502565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d92a3-6ad4-4e21-a4f2-45b22bc1c1b3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.540850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.541500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.541778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.542050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.542900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] RBAC: Adding query filter params (role.id=f52e0f4285db4c30ab63860a4fc840b1, user.id=416a8e6b151d4ab3accfe0fd8b3e3ddc, scope.system=all) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:02.543205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.544638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.557724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 183/367] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/role_assignments?user.id=416a8e6b151d4ab3accfe0fd8b3e3ddc&scope.system=all&role.id=f52e0f4285db4c30ab63860a4fc840b1 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:02.558532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.636261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 185/368] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:02.637591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.699464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:02.719499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37080-7f83-41e7-af5c-6573fccc0185 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.757274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a613eb0-77df-4691-accb-e916b91c1b69 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.759423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.760228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.760511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.760781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.776134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:02.785611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:02.786538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:02.787338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 184/369] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:02.787998 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.792560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:02.803317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.807372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.807372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.807372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.807372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.808070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.809970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 186/370] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:02.810681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.926063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8994d-c206-47e6-9135-e8226af10802 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.948861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb6613-f8a3-4f40-af15-93bca3855a9b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:02.964533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:02.965193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:02.965467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:02.965749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:02.966606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=27fd3f52f375402f8263c68266fcd5f0) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:02.967025 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:02.968412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:02.974536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 185/371] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:02.975256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:02.985607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:03.017443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:03.019960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.020683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.021169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.027865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:03.030607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:03.033563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 187/372] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:03.034652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:03.081106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:03.134387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afb466-eb1a-4819-8ad9-bae492388f2c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:03.189603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:03.191337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.191828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.192306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.193266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:03.193813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:03.195354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:03.204316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e121-560a-463b-ac7c-8ab2eded254a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:03.205477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 186/373] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:03.206518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:03.255903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:03.256588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.256833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.257105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.257990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=e8254b1130be4804a04301c20cc1c350) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:03.258349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:03.259791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:03.274338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 188/374] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:03 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:03.274338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:03.382244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dee489-d996-4c49-808c-e818ee9f5e51 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:03.396735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:03.443925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:03.452701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384cad2-24e1-4f45-bc2c-a5f229218662 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:03.466255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:03.467276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.467685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.468620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.469918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:03.471522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:03.473546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 187/375] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:03 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:03.483207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:03.500227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:03.500436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.500677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.500854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.613350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:03.615024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:03.622993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83023b-b50f-456d-bc1c-7700ec9e2ceb None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:03.668343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71476080-da52-4006-93c1-a714cbd5c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:03.669282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71476080-da52-4006-93c1-a714cbd5c323 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.669570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71476080-da52-4006-93c1-a714cbd5c323 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.669849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71476080-da52-4006-93c1-a714cbd5c323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.671571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71476080-da52-4006-93c1-a714cbd5c323 None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=27fd3f52f375402f8263c68266fcd5f0) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:03.672357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71476080-da52-4006-93c1-a714cbd5c323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:03.674066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71476080-da52-4006-93c1-a714cbd5c323 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:03.681503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 188/376] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:03 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:03.681860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:03.683785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9b4da-02b2-48f5-a3fd-23e3af19654b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.684080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9b4da-02b2-48f5-a3fd-23e3af19654b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.684362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9b4da-02b2-48f5-a3fd-23e3af19654b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.685923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 189/377] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:03.699935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883848-d0f4-4641-90c9-0c65d0b397d1 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.700290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883848-d0f4-4641-90c9-0c65d0b397d1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.700504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883848-d0f4-4641-90c9-0c65d0b397d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.732379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-22883848-d0f4-4641-90c9-0c65d0b397d1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:03.737155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-22883848-d0f4-4641-90c9-0c65d0b397d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:03.789800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 189/378] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:03.797102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:03.851284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:03.877061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 190/379] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:25:03.908999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883848-d0f4-4641-90c9-0c65d0b397d1 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:03.911122 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce6ef9-c82f-4fbf-a150-7106c2cd157d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:03.948814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:03.949723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:03.950114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:03.950425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] PATH_INFO: `/v3/projects/a3d3385220604fe5b83ffe6c82f91b54` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:03.951651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] RBAC: Authorizing `identity:get_project(project_id=a3d3385220604fe5b83ffe6c82f91b54)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:03.953170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:03.955332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 190/380] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:03 2022] GET /identity/v3/projects/a3d3385220604fe5b83ffe6c82f91b54 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:03.963302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:04.000781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:04.077763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883848-d0f4-4641-90c9-0c65d0b397d1 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:04.120638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63e665-8e51-41a1-8adf-f71087201ebe None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:04.140335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:04.141071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:04.141357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:04.141633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:04.152303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:04.160639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:04.162877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:04.164795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 191/381] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:04.170646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:04.170646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:04.170646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:04.170646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] PATH_INFO: `/v3/groups/787eccf933d2410f84ae98f37478afce` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:04.171760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:04.185995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] RBAC: Authorizing `identity:get_group(group_id=787eccf933d2410f84ae98f37478afce)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:04.188133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:04.197349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 191/382] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:03 2022] GET /identity/v3/groups/787eccf933d2410f84ae98f37478afce => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:04.204199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:04.264173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:04.369370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366bdae-07f8-48da-9162-eb65663feee1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:04.399327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:04.420278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:04.421842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:04.422472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:04.423925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:04.425507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:04.426712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:04.428409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:04.437700 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fec23-e9c5-4873-9d2f-18572448521c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:04.450919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 192/383] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:04.456525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:04.506542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:04.507510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:04.507975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:04.508528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:04.509659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] RBAC: Adding query filter params (group.id=787eccf933d2410f84ae98f37478afce, role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=a3d3385220604fe5b83ffe6c82f91b54) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:04.509970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:04.511425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:04.528029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 192/384] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:04 2022] GET /identity/v3/role_assignments?group.id=787eccf933d2410f84ae98f37478afce&scope.project.id=a3d3385220604fe5b83ffe6c82f91b54&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 260 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:04.617423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1994-0c68-4504-82e8-081383c70126 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:04.637363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:04.675994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:04.676805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:04.677093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:04.677371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:04.683223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:04.684730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:04.686904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 193/385] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:04 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:04.692930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:04.822590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0eb6b-6eb5-404c-b805-327a170b4038 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:04.858555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9984424-f028-4a24-a4c5-c2b0c364de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:04.859486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9984424-f028-4a24-a4c5-c2b0c364de25 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:04.859770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9984424-f028-4a24-a4c5-c2b0c364de25 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:04.860043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9984424-f028-4a24-a4c5-c2b0c364de25 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:04.861232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9984424-f028-4a24-a4c5-c2b0c364de25 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:04.862705 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9984424-f028-4a24-a4c5-c2b0c364de25 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:04.864739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 193/386] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:04 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:04.870191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:05.014046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4e5f2-685d-46f3-809e-bf932dd8bffe None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:05.050316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb98ce-38a3-4019-a038-32b67e1d8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:05.051604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb98ce-38a3-4019-a038-32b67e1d8d45 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:05.052096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb98ce-38a3-4019-a038-32b67e1d8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:05.052571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb98ce-38a3-4019-a038-32b67e1d8d45 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350/groups/723fb88577c94ec7b8134bc61d1e9449/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:05.054754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb98ce-38a3-4019-a038-32b67e1d8d45 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8254b1130be4804a04301c20cc1c350, group_id=723fb88577c94ec7b8134bc61d1e9449, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:05.056472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb98ce-38a3-4019-a038-32b67e1d8d45 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:05.136759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 194/387] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 19 21:25:04 2022] PUT /identity/v3/projects/e8254b1130be4804a04301c20cc1c350/groups/723fb88577c94ec7b8134bc61d1e9449/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:05.561653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3288-e0e4-4569-9a75-096a65013eb9 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:05.562133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3288-e0e4-4569-9a75-096a65013eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:05.562133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3288-e0e4-4569-9a75-096a65013eb9 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:05.563660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 194/388] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:05.569298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060e3a-303d-47bf-93bb-3ebceb53b6e9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:05.570101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060e3a-303d-47bf-93bb-3ebceb53b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:05.570602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060e3a-303d-47bf-93bb-3ebceb53b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:05.588286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-72060e3a-303d-47bf-93bb-3ebceb53b6e9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:05.589904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-72060e3a-303d-47bf-93bb-3ebceb53b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:05.625409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:05.659215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 195/389] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:25:05.681201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3288-e0e4-4569-9a75-096a65013eb9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:05.731682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:05.843542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3288-e0e4-4569-9a75-096a65013eb9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:05.891253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0aa52-d6a2-406d-aaf0-32212520bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:05.892104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aa52-d6a2-406d-aaf0-32212520bc4d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:05.892394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aa52-d6a2-406d-aaf0-32212520bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:05.892667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aa52-d6a2-406d-aaf0-32212520bc4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:05.905866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0aa52-d6a2-406d-aaf0-32212520bc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8ac0aa52-d6a2-406d-aaf0-32212520bc4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:05.913854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:05.914745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:05.915599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 195/390] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:05.923329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72060e3a-303d-47bf-93bb-3ebceb53b6e9 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:05.940263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d404-f4f2-432b-b08c-e4a166238275 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:05.940263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d404-f4f2-432b-b08c-e4a166238275 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:05.940263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d404-f4f2-432b-b08c-e4a166238275 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:05.941477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 196/391] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:05.947057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54319991-e3c9-4207-86ac-9b4e896d9289 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:05.947581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54319991-e3c9-4207-86ac-9b4e896d9289 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:05.948072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54319991-e3c9-4207-86ac-9b4e896d9289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:05.967367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-54319991-e3c9-4207-86ac-9b4e896d9289 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:05.969792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-54319991-e3c9-4207-86ac-9b4e896d9289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:06.053287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 197/392] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:25:06.079790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54319991-e3c9-4207-86ac-9b4e896d9289 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.092384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:06.130693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72060e3a-303d-47bf-93bb-3ebceb53b6e9 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.194744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54319991-e3c9-4207-86ac-9b4e896d9289 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.233186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.235084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.235567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.236056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.247430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:06.254898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.255584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.255865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.256141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.256987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:06.257212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:06.258116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:06.258945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:06.259530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:06.259530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:06.261864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 198/393] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:06.269214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.283755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 196/394] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:06.290913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.397767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:06.413154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5fc2-9606-4489-ad63-7b23a4c4c519 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.414571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:06.500576 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.501621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.502137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.502635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.503607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:06.504116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:06.505699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:06.511020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b43a45-a1bc-42e2-91ef-7ac7ee45a409 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.527157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 199/395] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:06.532931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.580808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e744ba-863b-4c65-9eec-84d936e3ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.581680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e744ba-863b-4c65-9eec-84d936e3ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.581965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e744ba-863b-4c65-9eec-84d936e3ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.582261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e744ba-863b-4c65-9eec-84d936e3ebd6 None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.583456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e744ba-863b-4c65-9eec-84d936e3ebd6 None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:06.584900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e744ba-863b-4c65-9eec-84d936e3ebd6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:06.586853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 197/396] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:06 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:06.592523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb2bd-8ad2-4073-893a-6b3bb260d30f None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.593675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb2bd-8ad2-4073-893a-6b3bb260d30f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.594164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb2bd-8ad2-4073-893a-6b3bb260d30f None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.595942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 198/397] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:06.596869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb2bd-8ad2-4073-893a-6b3bb260d30f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.669668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b542350-f194-48e6-8f93-f8ba6742325a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.703031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:06.709177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c34a7-13f7-4540-9982-9d0332d99a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.710322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c34a7-13f7-4540-9982-9d0332d99a1f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.710805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c34a7-13f7-4540-9982-9d0332d99a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.711366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c34a7-13f7-4540-9982-9d0332d99a1f None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.712752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c34a7-13f7-4540-9982-9d0332d99a1f None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:06.714691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c34a7-13f7-4540-9982-9d0332d99a1f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:06.721181 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 200/398] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:06 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:06.722721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e55be-8aae-4049-9fe6-0c2d463c59dd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.723255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e55be-8aae-4049-9fe6-0c2d463c59dd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.723730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e55be-8aae-4049-9fe6-0c2d463c59dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.728367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb2bd-8ad2-4073-893a-6b3bb260d30f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.734612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:06.741709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1e1e55be-8aae-4049-9fe6-0c2d463c59dd None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:06.743194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1e1e55be-8aae-4049-9fe6-0c2d463c59dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:06.774124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.775038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.775326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.775614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.777100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:06.778756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:06.780677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 199/399] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:06 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:06.781256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.822347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 201/400] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:06.823573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e55be-8aae-4049-9fe6-0c2d463c59dd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.897067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774990f-bc15-4f1c-93b1-3a25adab0ffc None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.946174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.946993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.947276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.947558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.948227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e55be-8aae-4049-9fe6-0c2d463c59dd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:06.948771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:06.950518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:06.953660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 200/401] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:06 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:06.954474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:06.978391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:06.987839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:06.989173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:06.989760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:06.990596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0/groups/723fb88577c94ec7b8134bc61d1e9449/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:06.994256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] RBAC: Authorizing `identity:create_grant(project_id=27fd3f52f375402f8263c68266fcd5f0, group_id=723fb88577c94ec7b8134bc61d1e9449, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:06.995473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:06.997303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:07.068024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7c44a-2772-4693-ae33-7b824d032313 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.076186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 202/402] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 19 21:25:06 2022] PUT /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0/groups/723fb88577c94ec7b8134bc61d1e9449/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:07.076794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:07.124459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.125980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.126764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.127341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.143689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:07.156558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:07.157532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:07.158372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:07.159641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 201/403] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:07.165853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:07.224305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09c581-d30a-4444-b88e-d33136c73673 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.263607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43711daa-a546-48d6-ad35-a98d3d533be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.265485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711daa-a546-48d6-ad35-a98d3d533be5 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.266014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711daa-a546-48d6-ad35-a98d3d533be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.266528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711daa-a546-48d6-ad35-a98d3d533be5 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350/groups/723fb88577c94ec7b8134bc61d1e9449/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.269132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711daa-a546-48d6-ad35-a98d3d533be5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8254b1130be4804a04301c20cc1c350, group_id=723fb88577c94ec7b8134bc61d1e9449, role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:07.270896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711daa-a546-48d6-ad35-a98d3d533be5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:07.328466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:07.334332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543296-7b57-4a24-a4c5-e579fdac319a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.369176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d788e3-43ea-493f-bced-dc41d47af397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.369902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d788e3-43ea-493f-bced-dc41d47af397 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.370186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d788e3-43ea-493f-bced-dc41d47af397 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.370504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d788e3-43ea-493f-bced-dc41d47af397 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.371296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d788e3-43ea-493f-bced-dc41d47af397 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:07.371611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d788e3-43ea-493f-bced-dc41d47af397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:07.372991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d788e3-43ea-493f-bced-dc41d47af397 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:07.386298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 202/404] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:07.386298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd8371-7a7d-4ce1-93c5-871d0e108c7e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.386298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd8371-7a7d-4ce1-93c5-871d0e108c7e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.386298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd8371-7a7d-4ce1-93c5-871d0e108c7e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.389459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 203/405] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:07.390819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd8371-7a7d-4ce1-93c5-871d0e108c7e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:07.402204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 203/406] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 19 21:25:07 2022] PUT /identity/v3/projects/e8254b1130be4804a04301c20cc1c350/groups/723fb88577c94ec7b8134bc61d1e9449/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:07.408199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893a6f-ee00-41be-bd0a-4e281f33e7b3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.408199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893a6f-ee00-41be-bd0a-4e281f33e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.408557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893a6f-ee00-41be-bd0a-4e281f33e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.451632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a8893a6f-ee00-41be-bd0a-4e281f33e7b3 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:07.452904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a8893a6f-ee00-41be-bd0a-4e281f33e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:07.512355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd8371-7a7d-4ce1-93c5-871d0e108c7e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.548004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:07.554523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.555833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.556278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.556715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.558179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:07.559949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:07.563079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 204/407] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:07 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:07.575532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:07.586249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 204/408] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:07.606803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8893a6f-ee00-41be-bd0a-4e281f33e7b3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:07.611907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:07.693160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d5e99-6aa8-432c-8507-8ba8a623c727 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.727095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8893a6f-ee00-41be-bd0a-4e281f33e7b3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.747281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.748208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.748591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.750071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.751324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:07.752769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:07.754936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 205/409] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:07 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:07.760522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:07.778373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.779106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.779391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.779665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.790883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:07.799724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:07.800603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:07.801941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 205/410] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:07.806959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:07.850203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:07.868627 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:07.876071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288f76-68c9-4be4-884f-d68ed05f1a3f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.911259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46da68e-cf44-4a5b-abc0-ffb30cc579de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.912136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46da68e-cf44-4a5b-abc0-ffb30cc579de None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.912419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46da68e-cf44-4a5b-abc0-ffb30cc579de None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.912695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46da68e-cf44-4a5b-abc0-ffb30cc579de None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0/groups/723fb88577c94ec7b8134bc61d1e9449/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.914926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46da68e-cf44-4a5b-abc0-ffb30cc579de None admin] RBAC: Authorizing `identity:create_grant(project_id=27fd3f52f375402f8263c68266fcd5f0, group_id=723fb88577c94ec7b8134bc61d1e9449, role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:07.916616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46da68e-cf44-4a5b-abc0-ffb30cc579de None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:07.933045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf9ff8-22e6-442d-902f-7da341668a63 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:07.968958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc559ba-1093-4abe-aec1-43dc715a4d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:07.969629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc559ba-1093-4abe-aec1-43dc715a4d3d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.969915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc559ba-1093-4abe-aec1-43dc715a4d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.970192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc559ba-1093-4abe-aec1-43dc715a4d3d None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.970963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc559ba-1093-4abe-aec1-43dc715a4d3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:07.971321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc559ba-1093-4abe-aec1-43dc715a4d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:07.972792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc559ba-1093-4abe-aec1-43dc715a4d3d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:07.981793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 206/411] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:07.990309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0300-3772-42f5-847e-b51c5a99cbf0 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:07.990309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0300-3772-42f5-847e-b51c5a99cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:07.990309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0300-3772-42f5-847e-b51c5a99cbf0 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:07.990309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 207/412] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:07.991218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0300-3772-42f5-847e-b51c5a99cbf0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:08.001038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 206/413] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 19 21:25:07 2022] PUT /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0/groups/723fb88577c94ec7b8134bc61d1e9449/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:25:08.003498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148a6-0f57-4a85-911d-73fe7061899c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:08.004031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148a6-0f57-4a85-911d-73fe7061899c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:08.004470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148a6-0f57-4a85-911d-73fe7061899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:08.026892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-039148a6-0f57-4a85-911d-73fe7061899c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:08.028871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-039148a6-0f57-4a85-911d-73fe7061899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:08.129906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 207/414] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:08.174755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:08.178093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039148a6-0f57-4a85-911d-73fe7061899c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:08.192115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0300-3772-42f5-847e-b51c5a99cbf0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:08.232066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:08.233246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:08.233854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:08.234075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] PATH_INFO: `/v3/groups/787eccf933d2410f84ae98f37478afce` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:08.235314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] RBAC: Authorizing `identity:get_group(group_id=787eccf933d2410f84ae98f37478afce)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:08.236826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:08.238859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 208/415] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:07 2022] GET /identity/v3/groups/787eccf933d2410f84ae98f37478afce => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:08.243942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:08.300473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:08.339752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039148a6-0f57-4a85-911d-73fe7061899c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:08.398744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceacd0-0743-465c-a0d2-88080e2cc223 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:08.418053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:08.419014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:08.419295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:08.419563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:08.445058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:08.453041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:08.453921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:08.454753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:08.456026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 208/416] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:08.459746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:08.478540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:08.479411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:08.479693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:08.479970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] PATH_INFO: `/v3/projects/a3d3385220604fe5b83ffe6c82f91b54` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:08.481189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] RBAC: Authorizing `identity:get_project(project_id=a3d3385220604fe5b83ffe6c82f91b54)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:08.482661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:08.485255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 209/417] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:08 2022] GET /identity/v3/projects/a3d3385220604fe5b83ffe6c82f91b54 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:08.491420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:08.570318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:08.629733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aba84a-74b0-4603-8d8d-09245813d8fa None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:08.677650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:08.678347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:08.678634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:08.678913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:08.679665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] RBAC: Adding query filter params (name=member) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:08.679975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:08.681351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:08.695351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 209/418] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:08.700906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:08.704534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889872f6-5b19-4a82-8e8e-26e53aac2205 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:08.710393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:08.741278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:08.742855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:08.743340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:08.743815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] PATH_INFO: `/v3/projects/a3d3385220604fe5b83ffe6c82f91b54/groups/787eccf933d2410f84ae98f37478afce/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:08.746023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3d3385220604fe5b83ffe6c82f91b54, group_id=787eccf933d2410f84ae98f37478afce, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:08.747786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:08.838536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 210/419] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 19 21:25:08 2022] PUT /identity/v3/projects/a3d3385220604fe5b83ffe6c82f91b54/groups/787eccf933d2410f84ae98f37478afce/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:08.842388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7cc8-5f19-4d97-84c5-44bd76d29c1c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:08.881176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:08.882291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:08.882834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:08.883306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:08.962509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:08.964412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:08.973610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:09.089905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 210/420] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:25:09.091317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:09.199961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:09.206309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a6439-04b3-4772-9f60-a030d1b2e6b7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:09.242104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:09.242996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:09.243280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:09.243554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:09.244759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:09.246200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:09.247912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 211/421] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:09 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:09.259324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:09.370413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04c79-59ca-4e44-8b85-a4ec70f6fc99 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:09.379104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:09.406773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9f50-5de2-4a31-97c5-658e27838c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:09.407659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9f50-5de2-4a31-97c5-658e27838c58 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:09.407939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9f50-5de2-4a31-97c5-658e27838c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:09.408217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9f50-5de2-4a31-97c5-658e27838c58 None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:09.409634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f9f50-5de2-4a31-97c5-658e27838c58 None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:09.411173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f9f50-5de2-4a31-97c5-658e27838c58 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:09.413291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 211/422] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:09 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:09.420372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:09.542617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9187-25ae-47d9-8a6d-b20740a5709b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:09.592114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23b1da-e789-4595-9279-286a31d3b5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:09.593693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b1da-e789-4595-9279-286a31d3b5bc None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:09.594182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b1da-e789-4595-9279-286a31d3b5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:09.594701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b1da-e789-4595-9279-286a31d3b5bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:09.595725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23b1da-e789-4595-9279-286a31d3b5bc None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=e8254b1130be4804a04301c20cc1c350) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:09.596268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23b1da-e789-4595-9279-286a31d3b5bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:09.597939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23b1da-e789-4595-9279-286a31d3b5bc None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:09.608596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 212/423] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:09 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:09.956723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26960ca4-b7cb-4347-9a62-f182e283550f None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:09.959258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26960ca4-b7cb-4347-9a62-f182e283550f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:09.959754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26960ca4-b7cb-4347-9a62-f182e283550f None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:09.963822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 212/424] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:09.971149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da076-c807-491b-9ead-e09140f559ee None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:09.971676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da076-c807-491b-9ead-e09140f559ee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:09.971676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da076-c807-491b-9ead-e09140f559ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:09.993996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4e3da076-c807-491b-9ead-e09140f559ee None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:09.995255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4e3da076-c807-491b-9ead-e09140f559ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:10.023773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:10.081047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 213/425] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:10.105271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26960ca4-b7cb-4347-9a62-f182e283550f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:10.182841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f3e1-9da1-44eb-b90e-b949d5e557ac None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.183187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f3e1-9da1-44eb-b90e-b949d5e557ac None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.183399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f3e1-9da1-44eb-b90e-b949d5e557ac None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.184916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 214/426] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:10.190882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57001-53ef-4777-bf07-cceb37a15d61 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.191171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57001-53ef-4777-bf07-cceb37a15d61 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.191450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57001-53ef-4777-bf07-cceb37a15d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.214512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-59d57001-53ef-4777-bf07-cceb37a15d61 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:10.219360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-59d57001-53ef-4777-bf07-cceb37a15d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:10.239947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26960ca4-b7cb-4347-9a62-f182e283550f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:10.299047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:10.300400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.300901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.301375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.317632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:10.329460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 215/427] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:10.330054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:10.331417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:25:10.333413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:10.336145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 213/428] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:10.347598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57001-53ef-4777-bf07-cceb37a15d61 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:10.365223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:10.409954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:10.466163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:10.480605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57001-53ef-4777-bf07-cceb37a15d61 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:10.482938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdc37a-27fc-4e44-88ae-3986f80a683b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:10.526126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:10.526522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:10.527197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.527479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.527716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.527833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.528246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.528491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:10.528802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:10.528943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.530199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:10.540194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 216/429] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:10.545562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:10.545732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:10.555990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:10.557092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:10.558075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:10.561875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 214/430] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:10.567952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:10.670517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:10.672791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a221494-f1a9-479a-b64f-dd4047b0658c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:10.677969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702aa9e-e5af-4f1b-b821-0c32a0999859 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:10.713799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:10.714669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.715140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.715515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.715855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122ada-6011-4d3d-ac30-ff89f19f8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:10.716513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:10.716866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:10.717075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122ada-6011-4d3d-ac30-ff89f19f8e7d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.718062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122ada-6011-4d3d-ac30-ff89f19f8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.718552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122ada-6011-4d3d-ac30-ff89f19f8e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.719230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:10.728500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 215/431] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:10.734098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:10.741143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:10.798832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122ada-6011-4d3d-ac30-ff89f19f8e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:10.800540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122ada-6011-4d3d-ac30-ff89f19f8e7d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:10.838954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe608b59-2661-4538-96e5-5d8755c0329d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:10.871976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b742d1-813b-47bb-89fe-959c23bf8031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:10.872599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b742d1-813b-47bb-89fe-959c23bf8031 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.872881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b742d1-813b-47bb-89fe-959c23bf8031 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.873156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b742d1-813b-47bb-89fe-959c23bf8031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.899087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:10.916971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 217/432] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:25:10.916971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d71b-6f31-4f85-a020-5ce48468a865 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:10.916971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d71b-6f31-4f85-a020-5ce48468a865 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:10.916971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d71b-6f31-4f85-a020-5ce48468a865 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:10.916971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 218/433] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:10.919059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d71b-6f31-4f85-a020-5ce48468a865 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:10.949237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b742d1-813b-47bb-89fe-959c23bf8031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:10.950737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b742d1-813b-47bb-89fe-959c23bf8031 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:10.975477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.030849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d71b-6f31-4f85-a020-5ce48468a865 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.051679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 216/434] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:25:11.057377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14634ce-248b-4f5e-82a9-d7be96e8fa77 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.057669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14634ce-248b-4f5e-82a9-d7be96e8fa77 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.057950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14634ce-248b-4f5e-82a9-d7be96e8fa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.066851 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.067706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.067990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.068266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.069566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.071054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:11.077634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 219/435] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:10 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:11.077634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.078647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b14634ce-248b-4f5e-82a9-d7be96e8fa77 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:11.079942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b14634ce-248b-4f5e-82a9-d7be96e8fa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:11.136693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.153828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 217/436] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:11.154718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14634ce-248b-4f5e-82a9-d7be96e8fa77 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.197965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406247d-8363-492c-a709-9c04ba0fd8f9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.216996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.234867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.235659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.235946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.236224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] PATH_INFO: `/v3/projects/e8254b1130be4804a04301c20cc1c350` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.237440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] RBAC: Authorizing `identity:get_project(project_id=e8254b1130be4804a04301c20cc1c350)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.238912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:11.244877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 220/437] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/projects/e8254b1130be4804a04301c20cc1c350 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:11.244877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.263806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14634ce-248b-4f5e-82a9-d7be96e8fa77 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.304210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.305068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.305353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.305826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.306821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.308262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:11.310032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 218/438] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:11.315979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.352946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d98288-8def-4b4c-a2c1-79571eb46488 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.379157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.391839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.392658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.392945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.393786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.404267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:11.412841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:11.413970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:11.414982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:11.417010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 221/439] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:11.422540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.431116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b0d7-926d-4d80-a63a-47933dbb3d93 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.469637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.470590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.470806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.471080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.472249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.472603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.473765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:11.475311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 219/440] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:11.486422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.533965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994cb7-e2f3-4ee9-a17f-2d3450fc867c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.567980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.568630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.568918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.569201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.570028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=2e1a7d8a55ac4d66b5464eafdab93afb, scope.project.id=27fd3f52f375402f8263c68266fcd5f0) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:11.570374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.571815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:11.578258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 222/441] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=2e1a7d8a55ac4d66b5464eafdab93afb => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:11.579054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.593294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9efa59-ab50-4a72-92d2-8d99752ce659 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.620037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.641730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34da620-0097-4e56-84ce-0bdbb4aee2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.642730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da620-0097-4e56-84ce-0bdbb4aee2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.642875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da620-0097-4e56-84ce-0bdbb4aee2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.643129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da620-0097-4e56-84ce-0bdbb4aee2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.644004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da620-0097-4e56-84ce-0bdbb4aee2c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:11.644322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da620-0097-4e56-84ce-0bdbb4aee2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.645886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da620-0097-4e56-84ce-0bdbb4aee2c6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:11.658590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 220/442] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:11.659961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eed2e-d8b6-448e-b731-c4a79d274480 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.660249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eed2e-d8b6-448e-b731-c4a79d274480 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.660529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eed2e-d8b6-448e-b731-c4a79d274480 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.661853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 221/443] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:11.666288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eed2e-d8b6-448e-b731-c4a79d274480 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.714387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2696d-57b2-43a7-8784-dfaa387efbf2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.726433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.759892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02259f25-075f-4735-9bdf-e2ccafdc8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.759892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259f25-075f-4735-9bdf-e2ccafdc8789 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.759892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259f25-075f-4735-9bdf-e2ccafdc8789 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.759892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259f25-075f-4735-9bdf-e2ccafdc8789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.760423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02259f25-075f-4735-9bdf-e2ccafdc8789 None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=e8254b1130be4804a04301c20cc1c350) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:11.760423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02259f25-075f-4735-9bdf-e2ccafdc8789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.760423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02259f25-075f-4735-9bdf-e2ccafdc8789 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:11.766262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 223/444] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=e8254b1130be4804a04301c20cc1c350&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:11.766262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a43dd1-313f-4a0c-aac6-018bf9178013 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.766262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a43dd1-313f-4a0c-aac6-018bf9178013 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.766262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a43dd1-313f-4a0c-aac6-018bf9178013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.783792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-28a43dd1-313f-4a0c-aac6-018bf9178013 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:11.785589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-28a43dd1-313f-4a0c-aac6-018bf9178013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:11.788336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eed2e-d8b6-448e-b731-c4a79d274480 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:11.838692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:11.839360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:11.839640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:11.839924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:11.876977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 224/445] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:11.899511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a43dd1-313f-4a0c-aac6-018bf9178013 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:11.910290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:11.927666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:11.929180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.017212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a43dd1-313f-4a0c-aac6-018bf9178013 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.021183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:12.050722 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 222/446] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:12.056086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:12.056642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.057314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.057495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.057946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.070230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:12.077966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:12.078942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:12.079905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 225/447] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:12.084832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:12.156237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:12.173809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890453-d694-48be-a060-4bcac3b6dcf5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.207614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350b54-95b9-4827-8a83-771577956285 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.216294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.218265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.218447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.218696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] PATH_INFO: `/v3/projects/27fd3f52f375402f8263c68266fcd5f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.220212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] RBAC: Authorizing `identity:get_project(project_id=27fd3f52f375402f8263c68266fcd5f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:12.222337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.223597 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 223/448] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/projects/27fd3f52f375402f8263c68266fcd5f0 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:12.229069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:12.249972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.250648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.251197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.251197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.251924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:12.252226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:12.254656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.266261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 226/449] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:12.269963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:12.303971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:12.346934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695727c4-4938-4b7a-9b4a-0ddcc57f1a26 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.384201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e81bf-db03-49fe-90e0-a3d946e24e07 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.389973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.390855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.391136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.391417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] PATH_INFO: `/v3/groups/723fb88577c94ec7b8134bc61d1e9449` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.392616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] RBAC: Authorizing `identity:get_group(group_id=723fb88577c94ec7b8134bc61d1e9449)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:12.394048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.395683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 224/450] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/groups/723fb88577c94ec7b8134bc61d1e9449 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:12.401408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:12.422369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:12.422860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.423513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.423799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.424079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.489865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:12.491369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.497490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e3473-de4c-4e5a-bd7c-8e8a77811293 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.518110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:12.531280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.531856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.532140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.532417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.533226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] RBAC: Adding query filter params (group.id=723fb88577c94ec7b8134bc61d1e9449, role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=27fd3f52f375402f8263c68266fcd5f0) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:12.533538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:12.534988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.540803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 225/451] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/role_assignments?group.id=723fb88577c94ec7b8134bc61d1e9449&scope.project.id=27fd3f52f375402f8263c68266fcd5f0&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:12.593713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 227/452] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:25:12.599563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:12.688062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:12.704643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50a3a8-9249-4419-8ee4-f60b9845cf14 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.742392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.743281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.743563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.743847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] PATH_INFO: `/v3/projects/a3d3385220604fe5b83ffe6c82f91b54` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.745032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=a3d3385220604fe5b83ffe6c82f91b54)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:12.746494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.748184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 226/453] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/projects/a3d3385220604fe5b83ffe6c82f91b54 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:12.753823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:12.853934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c8d2d-e624-4e06-9524-a90c09a3bad7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:12.879819 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:12.888183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b01f7-d1fa-4a7e-9171-58526cfc1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:12.889039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b01f7-d1fa-4a7e-9171-58526cfc1ceb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:12.889964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b01f7-d1fa-4a7e-9171-58526cfc1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:12.890315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b01f7-d1fa-4a7e-9171-58526cfc1ceb None admin] PATH_INFO: `/v3/groups/787eccf933d2410f84ae98f37478afce` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:12.896685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b01f7-d1fa-4a7e-9171-58526cfc1ceb None admin] RBAC: Authorizing `identity:get_group(group_id=787eccf933d2410f84ae98f37478afce)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:12.896685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b01f7-d1fa-4a7e-9171-58526cfc1ceb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:12.896685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 228/454] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/groups/787eccf933d2410f84ae98f37478afce => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:12.900323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:13.011923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47be6-6b22-49bd-aa64-102af3f68eb3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:13.046904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a6eda-bba3-48f8-bb54-3f0d8b1880ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:13.047557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6eda-bba3-48f8-bb54-3f0d8b1880ae None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:13.047843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6eda-bba3-48f8-bb54-3f0d8b1880ae None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:13.048124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6eda-bba3-48f8-bb54-3f0d8b1880ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:13.048949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a6eda-bba3-48f8-bb54-3f0d8b1880ae None admin] RBAC: Adding query filter params (group.id=787eccf933d2410f84ae98f37478afce, role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=a3d3385220604fe5b83ffe6c82f91b54) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:13.049266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a6eda-bba3-48f8-bb54-3f0d8b1880ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:13.050749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a6eda-bba3-48f8-bb54-3f0d8b1880ae None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:13.056514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 227/455] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 19 21:25:12 2022] GET /identity/v3/role_assignments?group.id=787eccf933d2410f84ae98f37478afce&scope.project.id=a3d3385220604fe5b83ffe6c82f91b54&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:15.733626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a11512-4bdc-4ab5-99e7-344a9d5e02f0 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:15.734146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a11512-4bdc-4ab5-99e7-344a9d5e02f0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:15.734237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a11512-4bdc-4ab5-99e7-344a9d5e02f0 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:15.735991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 229/456] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:15.742030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a846d8-1acf-482c-8ee4-eee2c52b2640 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:15.743031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a846d8-1acf-482c-8ee4-eee2c52b2640 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:15.743516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a846d8-1acf-482c-8ee4-eee2c52b2640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:15.771490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-38a846d8-1acf-482c-8ee4-eee2c52b2640 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:15.773072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-38a846d8-1acf-482c-8ee4-eee2c52b2640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:15.790802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:15.791339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05ca6-1872-43b8-b0b8-e2efcef3b861 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:15.791638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05ca6-1872-43b8-b0b8-e2efcef3b861 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:15.791917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05ca6-1872-43b8-b0b8-e2efcef3b861 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:15.793889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 230/457] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:15.800104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6123e-5cb3-4ba2-9493-db4b1f3f7407 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:15.800399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6123e-5cb3-4ba2-9493-db4b1f3f7407 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:15.800678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6123e-5cb3-4ba2-9493-db4b1f3f7407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:15.828885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b9d6123e-5cb3-4ba2-9493-db4b1f3f7407 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:15.831236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b9d6123e-5cb3-4ba2-9493-db4b1f3f7407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:15.893284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 228/458] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:15.917962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 231/459] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:15.931802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a846d8-1acf-482c-8ee4-eee2c52b2640 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:15.945625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4f76-e468-45ec-b0d5-e85380885593 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:15.945955 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4f76-e468-45ec-b0d5-e85380885593 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:15.946180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4f76-e468-45ec-b0d5-e85380885593 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:15.947841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 232/460] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:25:15.954256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f4f76-e468-45ec-b0d5-e85380885593 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.050695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a846d8-1acf-482c-8ee4-eee2c52b2640 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.087395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1b2d6-d33d-47a8-85b9-cc924cf376c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.088186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1b2d6-d33d-47a8-85b9-cc924cf376c6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.088464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1b2d6-d33d-47a8-85b9-cc924cf376c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.088737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1b2d6-d33d-47a8-85b9-cc924cf376c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.102155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f4f76-e468-45ec-b0d5-e85380885593 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.105358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1b2d6-d33d-47a8-85b9-cc924cf376c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.106869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1b2d6-d33d-47a8-85b9-cc924cf376c6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.115743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:16.127115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-56e1b2d6-d33d-47a8-85b9-cc924cf376c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:16.132696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:16.133536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:16.134909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:16.134909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:16.134909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:16.134909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:16.135163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 229/461] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:16.141453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce37f-3a4c-4871-834e-a427b439323f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.146004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce37f-3a4c-4871-834e-a427b439323f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.146100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.146192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce37f-3a4c-4871-834e-a427b439323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.146292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.146292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.146292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.156790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.159232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.163807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-60fce37f-3a4c-4871-834e-a427b439323f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:16.165842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-60fce37f-3a4c-4871-834e-a427b439323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:16.183472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:16.184497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:16.185535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:16.185535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:16.185535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:16.185535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:16.187785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 233/462] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:16.188709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.240687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 230/463] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:16.241699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fce37f-3a4c-4871-834e-a427b439323f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.328667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010360-7108-48d9-bf87-f15df299a9fd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.375738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fce37f-3a4c-4871-834e-a427b439323f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.392451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.393115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.393399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.393682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.394541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:16.394849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.396309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.410638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 234/464] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:16.411511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.414526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:16.423566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.426303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.426303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.426303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.426303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:16.426303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.427830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.444508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 231/465] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:16.445384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.467673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:16.550525 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cabd9-e011-4fa4-816d-ecd751647518 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.553417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a5d9-c5b8-417d-a4a7-045d6f1ac81e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.586356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.587110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.587398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.587674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.589308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55427836-22b2-40a7-91d3-1e0d868b1687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.589975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427836-22b2-40a7-91d3-1e0d868b1687 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.590292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427836-22b2-40a7-91d3-1e0d868b1687 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.590711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427836-22b2-40a7-91d3-1e0d868b1687 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.591269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55427836-22b2-40a7-91d3-1e0d868b1687 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.592772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55427836-22b2-40a7-91d3-1e0d868b1687 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.599500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.600962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:16.618408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:16.619367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:16.620185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:16.620185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:16.620185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:16.620185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:16.620185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 235/466] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:16.621695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.686385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 232/467] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:25:16 2022] POST /identity/v3/users => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:16.686385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088898-8725-452b-8629-3f26fbf53868 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.686385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088898-8725-452b-8629-3f26fbf53868 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.686385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088898-8725-452b-8629-3f26fbf53868 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.686385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 233/468] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:16.686385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae088898-8725-452b-8629-3f26fbf53868 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.737505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:16.746825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:16.764802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479dbdc-fbd7-4bcc-84d4-cb12262b7d33 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.814151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.815299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.815658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.816044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.816894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.818530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.827821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae088898-8725-452b-8629-3f26fbf53868 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:16.867337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316104c-8bcf-4781-8f3c-698175d2e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:16.867920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316104c-8bcf-4781-8f3c-698175d2e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.868268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316104c-8bcf-4781-8f3c-698175d2e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.868506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316104c-8bcf-4781-8f3c-698175d2e8ce None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.869224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316104c-8bcf-4781-8f3c-698175d2e8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:16.869529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316104c-8bcf-4781-8f3c-698175d2e8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:16.870964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316104c-8bcf-4781-8f3c-698175d2e8ce None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:16.885418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 234/469] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:16.887222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933782b-5754-4483-ab82-c8318e832cb3 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:16.887714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933782b-5754-4483-ab82-c8318e832cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:16.888192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933782b-5754-4483-ab82-c8318e832cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:16.900262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 236/470] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:25:16 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:16.905887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:16.919097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a933782b-5754-4483-ab82-c8318e832cb3 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:16.920039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a933782b-5754-4483-ab82-c8318e832cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:17.012770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 235/471] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:17.040777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933782b-5754-4483-ab82-c8318e832cb3 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:17.045524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feece2e-be5c-4ce2-b7c6-e67cb3be4345 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:17.093320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:17.095805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:17.096695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:17.097124 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:17.097641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:17.098394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:17.100149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:17.184502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933782b-5754-4483-ab82-c8318e832cb3 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:17.204004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:17.211900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 237/472] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:25:16 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:17.235226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bde521-6b98-41cc-bc32-d0dc37c59c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:17.236168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bde521-6b98-41cc-bc32-d0dc37c59c18 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:17.236458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bde521-6b98-41cc-bc32-d0dc37c59c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:17.236852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bde521-6b98-41cc-bc32-d0dc37c59c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:17.250301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bde521-6b98-41cc-bc32-d0dc37c59c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:17.251871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bde521-6b98-41cc-bc32-d0dc37c59c18 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-61bde521-6b98-41cc-bc32-d0dc37c59c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:17.273286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:17.274628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:17.275464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:17.275464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:17.275464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:17.275464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:17.275464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 236/473] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:17.284897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:17.416335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647f5d-2698-4059-aa40-b50f19fdf80f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:17.476658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bc04a-ae1c-454c-b92f-f62569e0914b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:17.477338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bc04a-ae1c-454c-b92f-f62569e0914b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:17.477818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bc04a-ae1c-454c-b92f-f62569e0914b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:17.479699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 237/474] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:17.481370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:17.482304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:17.483447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:17.484061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:17.484804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:17.485120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:17.485293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10261-13ec-4fe9-93c1-656e81a6f308 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:17.485563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10261-13ec-4fe9-93c1-656e81a6f308 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:17.485840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10261-13ec-4fe9-93c1-656e81a6f308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:17.487985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:17.501255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 238/475] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:17.503035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8af10261-13ec-4fe9-93c1-656e81a6f308 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:17.504230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8af10261-13ec-4fe9-93c1-656e81a6f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:17.506455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:17.579102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:17.591687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 238/476] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:25:17.614324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10261-13ec-4fe9-93c1-656e81a6f308 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:17.630690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e328-fb63-4312-9434-a2605f177837 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:17.641992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:17.666692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:17.667367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:17.667651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:17.667931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:17.668644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:17.670092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:17.738482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10261-13ec-4fe9-93c1-656e81a6f308 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:17.749855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 239/477] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:25:17 2022] POST /identity/v3/users => generated 249 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:25:17.786473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:17.787223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:17.787514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:17.787792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:17.788634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:17.790169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:17.835549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.sql.core [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 21:25:17.835549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 21:25:17.835549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [parameters: {'id': '26c574b28f1c4c5099cf84cd2a3f3183', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 21:25:17.835549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80350) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application conn.query(q) May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application result.read() May 19 21:25:17.857099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return ref.to_dict() May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:25:17.858047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application next(self.gen) May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application yield resource May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application next(self.gen) May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self.session.rollback() May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self.force_reraise() May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise self.value May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application session.commit() May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 21:25:17.859449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._prepare_impl() May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self.session.flush() May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._flush(objects) May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application compat.raise_( May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application flush_context.execute() May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rec.execute(self) May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 21:25:17.860510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:25:17.861354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application conn.query(q) May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application result.read() May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:25:17.862157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [parameters: {'id': '26c574b28f1c4c5099cf84cd2a3f3183', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:17.862979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 21:25:17.864825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:17.866921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 239/478] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 19 21:25:17 2022] POST /identity/v3/roles => generated 144 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:17.867058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:18.010163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34481a5-27e0-42b5-9e9e-ae40cef47456 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:18.027169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:18.045343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1305b1-7ca4-4f6c-ace1-06f772b64f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:18.046157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1305b1-7ca4-4f6c-ace1-06f772b64f82 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:18.046547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1305b1-7ca4-4f6c-ace1-06f772b64f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:18.046823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1305b1-7ca4-4f6c-ace1-06f772b64f82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:18.058328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1305b1-7ca4-4f6c-ace1-06f772b64f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7d1305b1-7ca4-4f6c-ace1-06f772b64f82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:18.067900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:18.068792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:25:18.069565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:18.070836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 240/479] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:18.075350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:18.228050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:18.256214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018667-399b-41bc-a0bb-cbff6a4091e8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:18.313894 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9091d-d263-4571-bf6b-08af3976e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:18.314850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9091d-d263-4571-bf6b-08af3976e29d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:18.315130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9091d-d263-4571-bf6b-08af3976e29d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:18.315400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9091d-d263-4571-bf6b-08af3976e29d None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:18.316142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9091d-d263-4571-bf6b-08af3976e29d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:18.316446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9091d-d263-4571-bf6b-08af3976e29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:18.317809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9091d-d263-4571-bf6b-08af3976e29d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:18.329596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 240/480] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:19.547281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc17c5-82b9-4c6d-aa6a-9b1c90c91a92 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:19.547775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc17c5-82b9-4c6d-aa6a-9b1c90c91a92 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:19.547775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc17c5-82b9-4c6d-aa6a-9b1c90c91a92 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:19.549384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 241/481] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:19.554255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f252c-623b-43b3-87c8-a522522342d9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:19.554641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f252c-623b-43b3-87c8-a522522342d9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:19.554817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f252c-623b-43b3-87c8-a522522342d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:19.574277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-da7f252c-623b-43b3-87c8-a522522342d9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:19.575434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-da7f252c-623b-43b3-87c8-a522522342d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:19.668582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 241/482] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:19.681029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db3ca6-6bd6-4b98-a3cd-9fbeb285151a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:19.681318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db3ca6-6bd6-4b98-a3cd-9fbeb285151a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:19.681649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db3ca6-6bd6-4b98-a3cd-9fbeb285151a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:19.683255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 242/483] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:19.688548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3330-0db2-4b6d-8aa9-98c3edadac38 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:19.688832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3330-0db2-4b6d-8aa9-98c3edadac38 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:19.689107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3330-0db2-4b6d-8aa9-98c3edadac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:19.704132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db3ca6-6bd6-4b98-a3cd-9fbeb285151a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:19.706481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-cc1b3330-0db2-4b6d-8aa9-98c3edadac38 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:19.707646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cc1b3330-0db2-4b6d-8aa9-98c3edadac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:19.838188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 242/484] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:19.873816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b3330-0db2-4b6d-8aa9-98c3edadac38 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:19.876636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:19.892401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db3ca6-6bd6-4b98-a3cd-9fbeb285151a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:19.936113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:19.936909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:19.937195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:19.937469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:19.964413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:19.973364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:19.974276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:19.975075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 243/485] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:19.980494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.054627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:20.095195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b3330-0db2-4b6d-8aa9-98c3edadac38 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.146408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.147237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.147522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.147798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.175720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:20.183683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:20.184588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:20.185360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:20.197800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 243/486] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:20.198760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.210583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168fa80-438f-4a20-9a85-a4d67f614edb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.290898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.291592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.292340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.292340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.292903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:20.293213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:20.294707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:20.315847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:20.317240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 244/487] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:20.322157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.361063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02312dd-3efb-406a-a031-332da5f2a165 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.398976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7dbc1-a703-484e-98b9-9db6f6325c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.400052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7dbc1-a703-484e-98b9-9db6f6325c1b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.400593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7dbc1-a703-484e-98b9-9db6f6325c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.401061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7dbc1-a703-484e-98b9-9db6f6325c1b None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.401986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7dbc1-a703-484e-98b9-9db6f6325c1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:20.402536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7dbc1-a703-484e-98b9-9db6f6325c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:20.404316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7dbc1-a703-484e-98b9-9db6f6325c1b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:20.413620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 244/488] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:20.415174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d60f8b-0a66-4ad4-90e9-236db93091e1 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.415665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d60f8b-0a66-4ad4-90e9-236db93091e1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.416191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d60f8b-0a66-4ad4-90e9-236db93091e1 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.417738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 245/489] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:20.426235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0945-9f37-48c8-ac4a-0178582b1647 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.426235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0945-9f37-48c8-ac4a-0178582b1647 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.426235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0945-9f37-48c8-ac4a-0178582b1647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.443939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:20.447995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7e5e0945-9f37-48c8-ac4a-0178582b1647 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:20.449198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7e5e0945-9f37-48c8-ac4a-0178582b1647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:20.449811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57b37-f33e-4cea-91ab-0bc3a7aa33be None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.494900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e320f-dfaf-49ed-ab9f-07e8b8d52e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.495689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e320f-dfaf-49ed-ab9f-07e8b8d52e54 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.495970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e320f-dfaf-49ed-ab9f-07e8b8d52e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.496598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e320f-dfaf-49ed-ab9f-07e8b8d52e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.507341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e320f-dfaf-49ed-ab9f-07e8b8d52e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:20.508777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e320f-dfaf-49ed-ab9f-07e8b8d52e54 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:20.526383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 246/490] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:20.526383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e0945-9f37-48c8-ac4a-0178582b1647 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-1c4e320f-dfaf-49ed-ab9f-07e8b8d52e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:20.526622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:20.527372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:20.528498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:20.528498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:20.528498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:20.528498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:20.532101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 245/491] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:20.533405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecda4fb-05ed-4e21-b463-0c18e6679dfa None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.533697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecda4fb-05ed-4e21-b463-0c18e6679dfa None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.533981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecda4fb-05ed-4e21-b463-0c18e6679dfa None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.535511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 246/492] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:20.536212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecda4fb-05ed-4e21-b463-0c18e6679dfa None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.588062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:20.632758 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e0945-9f37-48c8-ac4a-0178582b1647 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.646757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecda4fb-05ed-4e21-b463-0c18e6679dfa None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.670777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.671781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.672227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.672504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.681601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d838479-3b8f-4c05-8b0d-63d17e6b6729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.682290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d838479-3b8f-4c05-8b0d-63d17e6b6729 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.682577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d838479-3b8f-4c05-8b0d-63d17e6b6729 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.682852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d838479-3b8f-4c05-8b0d-63d17e6b6729 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.682976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:20.683570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d838479-3b8f-4c05-8b0d-63d17e6b6729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:20.683880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d838479-3b8f-4c05-8b0d-63d17e6b6729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:20.684318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:20.685233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d838479-3b8f-4c05-8b0d-63d17e6b6729 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:20.702037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 247/493] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:20.702037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38385-511f-4dc2-816d-1e26b64e6aab None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.702037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38385-511f-4dc2-816d-1e26b64e6aab None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.702037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38385-511f-4dc2-816d-1e26b64e6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:20.703454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:20.704456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:20.705481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:20.705481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:20.705481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:20.705481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:20.705481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 247/494] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:20.705481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.724140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3ef38385-511f-4dc2-816d-1e26b64e6aab None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:20.725316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3ef38385-511f-4dc2-816d-1e26b64e6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:20.729026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:20.801123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 248/495] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:20.801974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38385-511f-4dc2-816d-1e26b64e6aab None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.817760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe4272-f5a3-4169-8216-3cd05cb6402a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.827508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:20.853863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.854721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.855002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.855274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.866689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:20.874967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:20.876036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:20.876861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 248/496] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:20.877629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.918393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38385-511f-4dc2-816d-1e26b64e6aab None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:20.954375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:20.955161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:20.955445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:20.955721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:20.963024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:20.964472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:20.968010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:20.982257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:20.983922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 249/497] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:20.989550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:20.997750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886118c-5c87-4827-9189-bc4fe1e3132d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.034676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.035335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.035618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.035893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.036605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:21.036916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.038317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.050895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 249/498] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:21.051683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.080592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:21.104360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbbd1-f7b3-4003-a563-1c856112b5c5 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.145761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.146583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.146868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.147143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.158168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:21.162121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c35a4d-5fb0-4835-8cdd-a528a1fbd3e3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:21.165893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:21.166934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:21.167718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 250/499] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:21.168375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.203366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.203961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.204247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.204530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.205269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:21.205583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.206989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.215264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 250/500] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:21.216057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.236171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:21.278343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668265ec-90ae-43e7-a292-a8cdadfd5f30 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.315328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.315992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.316306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.316574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.317404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:21.317715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.319188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.320287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:21.332287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f8e1-e6b1-45f9-bdd0-ab602b401c82 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.356176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 251/501] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:21.357025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.369561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.370381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.370661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.370934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.378987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.380439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:21.396577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:21.397458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:21.398380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 251/502] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:21.398997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.462034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20ced0-c623-4825-a408-61eda4550c69 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.480025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:21.496345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7255-78e4-404f-a3b9-763fe3ca4bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.496793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04067772-cdab-49e1-8a0e-cb49648c1564 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.497077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7255-78e4-404f-a3b9-763fe3ca4bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.497362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7255-78e4-404f-a3b9-763fe3ca4bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.497639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7255-78e4-404f-a3b9-763fe3ca4bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.498496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7255-78e4-404f-a3b9-763fe3ca4bb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:21.498805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7255-78e4-404f-a3b9-763fe3ca4bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.500193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7255-78e4-404f-a3b9-763fe3ca4bb0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.512270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 252/503] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:21.512270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346cf2-0548-481f-a156-a3485271471c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.512270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346cf2-0548-481f-a156-a3485271471c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.512270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346cf2-0548-481f-a156-a3485271471c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.512270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 253/504] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:21.512270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346cf2-0548-481f-a156-a3485271471c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.535316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.536095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.536380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.536650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.547752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.549207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.556844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:21.566372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:21.572682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:21.573739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:21.573739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:21.573739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:21.573739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:21.573739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 252/505] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:21.573739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.614666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346cf2-0548-481f-a156-a3485271471c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.648243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199728ac-a099-4cae-b408-af0c6a070179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.648882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199728ac-a099-4cae-b408-af0c6a070179 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.649165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199728ac-a099-4cae-b408-af0c6a070179 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.649447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199728ac-a099-4cae-b408-af0c6a070179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.664705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73a41-56e4-4dea-8ff1-f7ce730b3741 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.696897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:21.697964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.698654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.698939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.699216 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.700039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:21.700347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.702439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.716451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199728ac-a099-4cae-b408-af0c6a070179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.717927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199728ac-a099-4cae-b408-af0c6a070179 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.738101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 253/506] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:21.738961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.797342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:21.816241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 254/507] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:21.817537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91365-9dd1-45e3-8160-135ae6d8a500 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.817816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91365-9dd1-45e3-8160-135ae6d8a500 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.818093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91365-9dd1-45e3-8160-135ae6d8a500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.837139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d1f91365-9dd1-45e3-8160-135ae6d8a500 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:21.838199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48e59-c6b7-4a46-9e92-eb9cf274f3a2 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:21.838328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1f91365-9dd1-45e3-8160-135ae6d8a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:21.871267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:21.872057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:21.872344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:21.872620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:21.882831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:21.884279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:21.901974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:21.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:21.903911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:21.903911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:21.903911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:21.903911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:21.903911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 254/508] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:21.904181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.914477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 255/509] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:21.914477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91365-9dd1-45e3-8160-135ae6d8a500 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:21.926235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.003681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91365-9dd1-45e3-8160-135ae6d8a500 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.011622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2513e-7908-4cc2-bf5b-69731166fbf8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.021969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.037037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.037773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.038125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.038492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.043855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.044514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.044800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.045605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.046340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:22.046651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.048032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.059714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 255/510] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:22.060527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.109379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.110871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.121708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.157195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d279-c72d-4673-a244-60d4bc143bb1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.192626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.193409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.193689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.193992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.204017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.205471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.210204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 256/511] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:22.211131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:22.226013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:22.227055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:22.227912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:22.227912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:22.227912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:22.227912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:22.227912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 256/512] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:22.228285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.254916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.312544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9461e9-d022-4af4-91fb-ab2d5c2bf296 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.323764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.328510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201900-c19d-4f2e-89d9-419ca039f483 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.346367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.347020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.347307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.347584 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.348299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:22.348607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.349990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.361272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.361713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 257/513] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:22.362065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.362283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.362368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.362650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.376364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.377806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:22.394726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:22.395595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:22.396438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:22.396438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:22.396438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:22.396438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:22.396438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 257/514] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:22.396702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.475147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.480256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72217be3-510e-4667-8bb8-a8d603210d44 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.499185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329eef29-aa07-4e26-9ce0-35564ac8c223 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.513508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.514284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.514566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.514838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.522215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.523710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.532991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.533774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.534061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.534379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:22.538154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:22.539228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:22.540308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 258/515] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:22.540932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.546787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.548234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:22.565800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:22.566664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:22.567480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:22.567480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:22.567480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:22.567480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:22.567480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 258/516] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:22.567772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.573959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.641018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7d4c7-5763-4d73-8560-c9b900be633f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.665817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a33020-c847-4005-9837-ec4c9660f200 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.674145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.674839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.675117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.675394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.676098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:22.676400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.677761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.689041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 259/517] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:22.690083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.691831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.700939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.701743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.706307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.706307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.709175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.710657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:22.725949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:22.727031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 259/518] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:22.728050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.779942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.788834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090b725-d758-40e7-94d2-a412ac28d87a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.823095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.823743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.824028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.824304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.825017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:22.825325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.825666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd387-e24a-4da3-8947-05e11627ca7a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.826799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.837909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 260/519] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:22.838562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.860972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.861638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.861924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.862228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.863056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:22.863367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.864796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.881805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 260/520] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:22.882625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.927437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:22.935347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0e4c6-06a2-40c0-9ba2-fdb5f16a51bc None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.968421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:22.969070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:22.969348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:22.969625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:22.970362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:22.970672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:22.972027 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:22.981849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4bc7b-1e99-4cea-8990-4169119b5a6c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:22.983916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 261/521] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:22.984734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:22.996085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.017628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.018522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.018810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.019087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.025670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.027191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:23.041343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:23.042464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 261/522] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:23.048559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.084475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142064-c39c-4c37-b8a4-a8b616bcea88 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.117761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.118529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.118892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.119239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.120130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:23.120455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.121894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.139911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 262/523] 10.222.0.59 () {56 vars in 1139 bytes} [Thu May 19 21:25:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:23.140712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.143180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f2f4e-3efd-425e-a0a9-91cf858dcf0b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.146323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.176956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.177712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.178056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.178447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.179333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.180828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.206146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.238043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bbf6f-7d47-475f-91e0-f69c56c25fa3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.269445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.270074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.270390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.270661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.294773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 262/524] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:25:23 2022] POST /identity/v3/users => generated 247 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:23.294773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.356178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.358461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.407570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65930db-c29e-4466-9b15-e7ce448c4c0c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.435269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.445433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.446263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.446548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.446822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.454948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.456496 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:23.472896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:23.475108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:23.475964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:23.476383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 263/525] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:23.476383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.480993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 263/526] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:23.480993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.511626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.590148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6811a-bb51-4011-b09f-678955b1ac6f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.597110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2cd36-d4f6-4025-85f7-78d7b97031aa None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.625426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294351c4-589e-4985-87f3-25491da6062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.626084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294351c4-589e-4985-87f3-25491da6062b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.626403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294351c4-589e-4985-87f3-25491da6062b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.626899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294351c4-589e-4985-87f3-25491da6062b None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.627461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294351c4-589e-4985-87f3-25491da6062b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:23.627772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294351c4-589e-4985-87f3-25491da6062b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.629204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294351c4-589e-4985-87f3-25491da6062b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.631738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.632464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.632817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.633169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.653022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 264/527] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:23.653022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294351c4-589e-4985-87f3-25491da6062b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.684417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.705038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.706541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.729629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.760252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294351c4-589e-4985-87f3-25491da6062b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.800100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.800979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.801331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.801709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.813175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.814924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.818178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 264/528] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:23.823304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:23.833346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:23.834187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:23.835085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:23.835085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:23.835085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:23.835085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:23.835085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 265/529] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:23.835788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:23.921794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.938091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfb06f-4ece-430e-8dd6-e1777cfd98cc None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.941120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef438-cbf2-44b3-84d5-b57ec74990ed None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:23.960469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:23.976575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.976776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:23.977244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.977528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.977623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:23.977803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.978076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:23.978474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:23.978657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=37df82be35a448bf819e4f157741b8f1) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:23.978969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.979524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:23.979938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:23.980463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.981536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:23.986741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 266/530] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/role_assignments?user.id=37df82be35a448bf819e4f157741b8f1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:23.987405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.016281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 265/531] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:24.017642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.111279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9d56-d139-4ba9-9a58-7fe910128dff None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.168476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56bed-fbd9-4d5a-8441-79699aeb13c6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.170592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.171783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.172123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.172350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.185184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.187774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:24.190166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:24.213726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:24.214805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:24.215747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:24.215747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:24.215747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:24.215747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:24.215747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 267/532] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:24.216058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.218120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.218966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.219347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.219811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.220668 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:24.220983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.222446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:24.241179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 266/533] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:24.242058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.305269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:24.352253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02760343-f0af-426f-a55e-92257a76fa75 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.368957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f99f-cba0-44a8-8aef-8aa2e43a62a6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.397003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.398366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.399060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.399527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.400677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=013746216dae469180f001d17ef6374e) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:24.401432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.403309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:24.406340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.407075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.407725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.407725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.408495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:24.408879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.410343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:24.411562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 268/534] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/role_assignments?user.id=013746216dae469180f001d17ef6374e&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:24.412790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.429506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 267/535] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:24.435311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.544581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:24.593690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54505a14-46db-4c00-b0e0-f999cc2038c6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.634658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.635875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.636365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.636842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.645829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.647927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:24.665768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:24.666691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:24.667507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:24.669932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 269/536] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:24.677374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.684890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:24.688467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe62b2-382c-4146-93d4-34e7e1e0c902 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.730243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.730243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.730243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.730243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.737212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.742243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:24.764610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:24.765472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:24.766321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 268/537] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:24.772585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.856159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e082ff-6cf9-427e-b106-50f1b8936887 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.898566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:24.915164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d38dc-41c7-4872-9282-f8ff90d6e301 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:24.931364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.933442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.936108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.936607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.937653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:24.939399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.943667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:24.965864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:24.966050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 270/538] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:24.967507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:24.972411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:24.972411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:24.972411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:24.972411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:24.973296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:24.973486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:25.006253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 269/539] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:25.022862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:25.070262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:25.150195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4fcd4-0a55-48fb-a7ec-7c5565608c09 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:25.197774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cea01f-d0d1-43ea-8a25-c03633ed110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:25.197774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea01f-d0d1-43ea-8a25-c03633ed110d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:25.197774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea01f-d0d1-43ea-8a25-c03633ed110d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:25.197774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea01f-d0d1-43ea-8a25-c03633ed110d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:25.198172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cea01f-d0d1-43ea-8a25-c03633ed110d None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=65573e15809c42a98cc3e603355df832) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:25.198172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cea01f-d0d1-43ea-8a25-c03633ed110d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:25.198172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cea01f-d0d1-43ea-8a25-c03633ed110d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:25.204104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 271/540] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:24 2022] GET /identity/v3/role_assignments?user.id=65573e15809c42a98cc3e603355df832&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:25.276551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d8b94-cb65-46f2-a353-ecf8b28ec615 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:25.375716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37f7d5-f0a1-40c0-96db-807609658545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:25.376405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f7d5-f0a1-40c0-96db-807609658545 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:25.376692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f7d5-f0a1-40c0-96db-807609658545 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:25.376972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f7d5-f0a1-40c0-96db-807609658545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:25.377811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37f7d5-f0a1-40c0-96db-807609658545 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=40b920b115454a708a14a62ead99eccd) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:25.378140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37f7d5-f0a1-40c0-96db-807609658545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:25.379634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37f7d5-f0a1-40c0-96db-807609658545 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:25.397569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 270/541] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:25 2022] GET /identity/v3/role_assignments?user.id=40b920b115454a708a14a62ead99eccd&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 259 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:25.790393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43bcea-4653-4538-bb50-06aa997bb831 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:25.790393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43bcea-4653-4538-bb50-06aa997bb831 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:25.790393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43bcea-4653-4538-bb50-06aa997bb831 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:25.792358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 272/542] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:25.798069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb60d55-005b-4fee-9683-2808caa6f816 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:25.798572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb60d55-005b-4fee-9683-2808caa6f816 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:25.798756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb60d55-005b-4fee-9683-2808caa6f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:25.817525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6bb60d55-005b-4fee-9683-2808caa6f816 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:25.818758 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6bb60d55-005b-4fee-9683-2808caa6f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:25.889532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 271/543] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:25.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43bcea-4653-4538-bb50-06aa997bb831 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:25.961062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:26.027092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43bcea-4653-4538-bb50-06aa997bb831 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:26.065941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:26.066689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:26.066974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:26.067253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:26.079082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:26.087096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:26.088047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:26.088846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 273/544] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:26.095224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb60d55-005b-4fee-9683-2808caa6f816 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:26.114060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:26.244004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb60d55-005b-4fee-9683-2808caa6f816 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:26.294945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:26.295893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:26.296354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:26.296802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:26.297744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:26.298266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:26.299845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:26.308942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 272/545] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:26.315318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:26.445841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203dbc-213d-490e-8eb2-ee0c8699c1b1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:26.454634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:26.501465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:26.502278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:26.502566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:26.502843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:26.514982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:26.516478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:26.546805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:26.547716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:26.548541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:26.548541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:26.548541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:26.548541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:26.551892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 274/546] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:26.563343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:26.680636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:26.710122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526e9c2-fba4-40a9-89da-9fd271995077 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:26.760764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3110c03-879f-4fe5-b230-80a5f3ff2059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:26.761432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3110c03-879f-4fe5-b230-80a5f3ff2059 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:26.761718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3110c03-879f-4fe5-b230-80a5f3ff2059 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:26.762001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3110c03-879f-4fe5-b230-80a5f3ff2059 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:26.762743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3110c03-879f-4fe5-b230-80a5f3ff2059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:26.763052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3110c03-879f-4fe5-b230-80a5f3ff2059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:26.764455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3110c03-879f-4fe5-b230-80a5f3ff2059 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:26.781685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 273/547] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:26.787174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:26.869346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093affb-077a-4dad-8d08-eb234be6f6f8 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:26.870018 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093affb-077a-4dad-8d08-eb234be6f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:26.870018 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093affb-077a-4dad-8d08-eb234be6f6f8 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:26.871598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 274/548] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:26.877003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87ecb9-f718-484b-baf9-029fbd37a847 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:26.877315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87ecb9-f718-484b-baf9-029fbd37a847 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:26.877556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87ecb9-f718-484b-baf9-029fbd37a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:26.907201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ed87ecb9-f718-484b-baf9-029fbd37a847 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:26.908840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ed87ecb9-f718-484b-baf9-029fbd37a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:26.932785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8aefa-c128-47b8-9c6e-56d14ecf408f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:26.968795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:26.969536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:26.969824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:26.970104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:26.979179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:26.980665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:26.999903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:27.000890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:27.001825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 275/549] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:27.007154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.032904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 275/550] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:25:27.046627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:27.065664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87ecb9-f718-484b-baf9-029fbd37a847 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.115887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d4d1-db3f-4e36-b374-31a51a25c95b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:27.155322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:27.156144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.156432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.156727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.157546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:27.157854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:27.159733 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:27.180223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 276/551] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:27.185211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.205606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:27.251892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87ecb9-f718-484b-baf9-029fbd37a847 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:27.268767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:27.301096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b679cf-a917-4c86-a31a-b63aab3e99b2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:27.307180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5608bd3-6ec1-4e48-bd08-3861cc4a6e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:27.308243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5608bd3-6ec1-4e48-bd08-3861cc4a6e3f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.308690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5608bd3-6ec1-4e48-bd08-3861cc4a6e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.309585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5608bd3-6ec1-4e48-bd08-3861cc4a6e3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.324715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5608bd3-6ec1-4e48-bd08-3861cc4a6e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-e5608bd3-6ec1-4e48-bd08-3861cc4a6e3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:27.335237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:27.336152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:27.336960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 276/552] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:27.337703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099abc71-78de-4dfa-a9ca-c74335e8e7cc None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.338292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099abc71-78de-4dfa-a9ca-c74335e8e7cc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.339646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099abc71-78de-4dfa-a9ca-c74335e8e7cc None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.340907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 277/553] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:27.343354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:27.344022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.344306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.344579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.346320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2896-4e7c-43e0-a02a-7af82d9b11b7 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.346645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2896-4e7c-43e0-a02a-7af82d9b11b7 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.346928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2896-4e7c-43e0-a02a-7af82d9b11b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.364337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5d1f2896-4e7c-43e0-a02a-7af82d9b11b7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:27.365580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5d1f2896-4e7c-43e0-a02a-7af82d9b11b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:27.423725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:27.425678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:27.442175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 278/554] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:27.443162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2896-4e7c-43e0-a02a-7af82d9b11b7 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.512827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:27.523011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:27.546549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 277/555] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:27.547468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.580298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2896-4e7c-43e0-a02a-7af82d9b11b7 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:27.626585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:27.627630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.628115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.628594 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.629601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:27.630177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:27.632320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:27.644449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 279/556] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:27.646141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.663026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dda1e-ebf0-4ec9-b8de-ebeb1fb4bd2c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:27.703350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:27.704259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.704613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.704962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.715843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:27.724233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:27.725119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:27.725934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:27.730254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 278/557] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:27.731151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.765855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7367-e98e-4398-ad95-a614a43ff48c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:27.766260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:27.784748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:27.808017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:27.809905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.810481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.810908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.824675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:27.826956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:27.843249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4036c7-0ff3-414c-a3fe-7f8e49f23fab None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:27.850678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:27.852196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:27.853271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:27.853271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:27.853271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:27.853271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:27.860906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 280/558] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:27.860906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.886963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:27.888130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:27.888780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:27.889457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:27.903397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:27.906097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:27.927469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:27.928418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:27.929385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:27.929385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:27.929385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:27.929385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:27.931783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 279/559] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:27.932997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:27.974014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02c583-3fc5-42e2-8fbd-551c013878b4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.009909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.010628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.010911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.011184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.012024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:28.012336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.014581 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.028503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 281/560] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:28.028503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.037352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.055332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6d5c-2272-4194-962d-8da4d401e480 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.068041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.098645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.099314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.099627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.099871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.100599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:28.100910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.102436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.118258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 280/561] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:28.118258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.150502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17edd7f-a3a6-4392-98e4-24640bb7056b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.186158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea5d82-cfb0-45d4-9fc3-4265f5101813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.186892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea5d82-cfb0-45d4-9fc3-4265f5101813 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.187179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea5d82-cfb0-45d4-9fc3-4265f5101813 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.187462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea5d82-cfb0-45d4-9fc3-4265f5101813 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.188203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea5d82-cfb0-45d4-9fc3-4265f5101813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:28.188525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea5d82-cfb0-45d4-9fc3-4265f5101813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.190306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea5d82-cfb0-45d4-9fc3-4265f5101813 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.208611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 282/562] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:28.208611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fb36c-9299-4ca9-9c98-a80f97862f0b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.208611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fb36c-9299-4ca9-9c98-a80f97862f0b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.208611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fb36c-9299-4ca9-9c98-a80f97862f0b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.208611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 283/563] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:28.208611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fb36c-9299-4ca9-9c98-a80f97862f0b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.242171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954e9d-abfc-4715-8f93-812510bd5819 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.280690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.281466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.281757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.282032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.293968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.296039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.302953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.312479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:28.314763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:28.315665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:28.316585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:28.316585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:28.316585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:28.316585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:28.316585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 281/564] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:28.316914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.327658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fb36c-9299-4ca9-9c98-a80f97862f0b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.360585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec260-0b35-4a4f-9ee4-396faa4c063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.361374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec260-0b35-4a4f-9ee4-396faa4c063f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.361654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec260-0b35-4a4f-9ee4-396faa4c063f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.361923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec260-0b35-4a4f-9ee4-396faa4c063f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.369302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec260-0b35-4a4f-9ee4-396faa4c063f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.370779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec260-0b35-4a4f-9ee4-396faa4c063f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-c9bec260-0b35-4a4f-9ee4-396faa4c063f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:28.385068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:28.386142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:28.387098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 284/565] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:28.387599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa36e1-882b-4280-bfb5-efdc4b1fda32 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.387674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa36e1-882b-4280-bfb5-efdc4b1fda32 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.387923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa36e1-882b-4280-bfb5-efdc4b1fda32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.403775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9afa36e1-882b-4280-bfb5-efdc4b1fda32 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:28.405526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9afa36e1-882b-4280-bfb5-efdc4b1fda32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:28.419206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3607b-c344-498a-95e1-41f493f268d8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.452967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853751ad-bd8a-4d9a-b2ed-82ea1cbe9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.453750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853751ad-bd8a-4d9a-b2ed-82ea1cbe9953 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.454032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853751ad-bd8a-4d9a-b2ed-82ea1cbe9953 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.454336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853751ad-bd8a-4d9a-b2ed-82ea1cbe9953 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.461663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853751ad-bd8a-4d9a-b2ed-82ea1cbe9953 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.463141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853751ad-bd8a-4d9a-b2ed-82ea1cbe9953 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.484657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 285/566] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:28.484657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa36e1-882b-4280-bfb5-efdc4b1fda32 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-853751ad-bd8a-4d9a-b2ed-82ea1cbe9953 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:28.484894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:28.485928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 282/567] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372655-8acd-4411-8117-bf76e8c03952 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.487563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372655-8acd-4411-8117-bf76e8c03952 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.488832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372655-8acd-4411-8117-bf76e8c03952 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.488832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 283/568] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:28.488832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372655-8acd-4411-8117-bf76e8c03952 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.565987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.579763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.597368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa36e1-882b-4280-bfb5-efdc4b1fda32 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.606291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372655-8acd-4411-8117-bf76e8c03952 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.629904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.630589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.630874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.631148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.631852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:28.632156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.633516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.640490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678c6d1-6e31-4b7e-a39c-ae081bb5b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.641138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678c6d1-6e31-4b7e-a39c-ae081bb5b0ff None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.641432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678c6d1-6e31-4b7e-a39c-ae081bb5b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.641713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678c6d1-6e31-4b7e-a39c-ae081bb5b0ff None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.642558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678c6d1-6e31-4b7e-a39c-ae081bb5b0ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:28.642876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678c6d1-6e31-4b7e-a39c-ae081bb5b0ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.644305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678c6d1-6e31-4b7e-a39c-ae081bb5b0ff None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.644682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 286/569] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:28.645543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.661570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 284/570] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:28.661570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51193-cdc8-4bd5-806e-ba189e07714f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.661570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51193-cdc8-4bd5-806e-ba189e07714f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.661570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51193-cdc8-4bd5-806e-ba189e07714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.674839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c3f51193-cdc8-4bd5-806e-ba189e07714f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:28.676033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c3f51193-cdc8-4bd5-806e-ba189e07714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:28.750274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 285/571] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:28.751484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51193-cdc8-4bd5-806e-ba189e07714f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.752923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df489-0a07-400b-a1b3-fe02fb5c0027 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.788383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.789057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.789342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.789621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.790509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:28.790829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.792282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:28.802500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.807481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:28.811039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 287/572] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:28.818203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.860255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51193-cdc8-4bd5-806e-ba189e07714f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.905322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.906109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.906419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.906695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.917533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:28.925234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:28.926320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:28.927221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 286/573] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:28.927922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:28.940893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1378c8-cae6-4659-9ff7-2d607b60fa99 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:28.981058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:28.981886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:28.982176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:28.982483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] PATH_INFO: `/v3/users/glance` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:28.990894 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:28.992428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:29.008168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:29.009301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 288/574] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:29.010433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.034661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8055262-a1b6-4fac-8871-081b32aca46a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.043951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.070050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.071215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.071953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.072243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.072521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.073352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=4af877878304440b9aa24964dedfadf1) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:29.073667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.075164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.081471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 287/575] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:28 2022] GET /identity/v3/role_assignments?user.id=4af877878304440b9aa24964dedfadf1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:29.082311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.130500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44b4c-1ab4-4994-92cd-3843e0bfa5ce None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.170683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.171497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.171780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.172054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.184842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:29.193708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:29.194771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:29.195602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 289/576] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:29.196291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.209617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4fb84-7630-4e45-b1ca-1e084b2c6b68 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.248841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.249643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.249924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.250193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.262187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.264707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:29.283653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:29.284557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:29.285431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:29.285431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:29.285431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.285431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:29.285431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 288/577] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:29.286070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.313843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.317592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d34f3-bc67-4fdf-9c75-e204ca032f22 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.339940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.355627 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.356347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.356630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.356903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.357684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:29.357989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.359393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.368337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 290/578] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:29.369015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.401567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf176b3-3634-4426-85d9-f26ec900f6b6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.438545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.439468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.439745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.440018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.440847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:29.441153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.442607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.461294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 289/579] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:29.462135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.493767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbf7c-a1b3-4ad6-a44d-6c57c23c1182 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.530314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.531254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.531694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.532063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.532708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:29.533014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.534408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.542548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 291/580] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:29.543379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.569731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.591518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.595036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627964-291e-443c-8dd6-fcd83fd0fc86 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.634008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.634727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.635030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.635289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.636012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:29.636322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.637691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.653099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 290/581] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:29.653099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.656029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38cc18-f040-4008-a4c2-e0fa07c5cf0d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.693497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.694310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.694593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.694867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.705817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.707393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:29.725454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:29.726502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:29.727396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:29.727396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:29.727396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.727396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:29.727396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 292/582] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:29.727678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.761756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb2b04-b768-4417-902f-42279ff860a6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.796482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.797285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.797571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.797824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.808488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.809911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.812281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.823907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:29.829734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e5af7-b0e7-4322-9c22-180520715c74 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:29.830671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:29.831589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:29.837295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:29.837295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:29.837295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.837295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:29.837295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 291/583] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:29.837295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.872314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.874573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.875022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.875466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:29.886352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:29.887810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:29.905976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:29.907052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:29.907954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:29.907954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:29.907954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:29.907954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:29.907954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 293/584] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:29.908290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:29.953514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349203-b68e-491a-8703-655aa6ce1456 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:29.990132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:29.991264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:29.991825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:29.992105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.000574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.002503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.011610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535d29a-4ad9-4cf1-887b-aff857ee7cfe None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:30.017351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:30.018840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 292/585] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:30.019750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.052597 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.053276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.053555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.053859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.054552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:30.054864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.056230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.069915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 294/586] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:30.071270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.078406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.085768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.125159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75a72-4811-4381-aa7e-8ed32b555b16 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.161104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.161870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.162278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.162620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.163400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:30.163819 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.165244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.181987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 293/587] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:30.181987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.185820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039cd7-05b7-4788-b579-0a163a7fde81 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.222348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.223015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.223301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.223578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.224290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:30.224600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.225967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.237948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 295/588] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:30.238779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.295164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d136-6c9c-403f-9fee-053614ef5274 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.311478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.322243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.332009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.332670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.332955 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.333290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.334087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:30.334627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.335914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.349125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 294/589] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:30.349939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.361328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd957-f790-4038-9708-5300f6d9dbfd None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.397341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.398133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.398609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.398892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.408053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.409511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:30.423916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:30.424945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 296/590] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:30.425888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.460898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de34fd-e217-4c3b-9938-a2a72a8612ac None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.496508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.497289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.497583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.498410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.508520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.510038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:30.524494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:30.525553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 295/591] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:30.526465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.549866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe319d2-241b-421b-8154-423e85861a51 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.564702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.580111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.587435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.588223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.588505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.588778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.596041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.597481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:30.612004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:30.613182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 297/592] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:30.619061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.642470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e314c-5abd-4a48-ba50-672017328e57 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.678237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.679054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.679337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.679612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/37df82be35a448bf819e4f157741b8f1/roles/24d080895b854a35950230f3ec003570` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.694240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=37df82be35a448bf819e4f157741b8f1, role_id=24d080895b854a35950230f3ec003570)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.695686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.719697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955b68-9464-4b9b-9c5e-e7ca2f346dc3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.753224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.753928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.754245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.754513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.755333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:30.755636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.757061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.770473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 296/593] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:30 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/37df82be35a448bf819e4f157741b8f1/roles/24d080895b854a35950230f3ec003570 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:30.770473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.795671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 298/594] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:30.796685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.853277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.883513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:30.903535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771443da-fb88-4f06-af63-c4b4283a5f1a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.924580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d38f67-341a-431f-b0c8-b54e89595d08 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:30.951104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.951786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.952135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.952468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.953526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:30.954323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.956142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.970975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:30.971654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:30.971956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 297/595] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:30.972250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:30.972525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:30.972872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:30.973374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:30.973688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:30.975230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:30.998895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 299/596] 10.222.0.59 () {56 vars in 1139 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:31.003252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.095387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689090ee-9afb-4235-b213-9a86b6d5188e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.108441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3886d-f4f2-42df-b42a-adbfac544910 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.127139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:31.137745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.139574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.139859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.140293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.147606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.148773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.149152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.149524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/013746216dae469180f001d17ef6374e/roles/24d080895b854a35950230f3ec003570` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.153802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:31.156798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:31.160008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:31.170889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=013746216dae469180f001d17ef6374e, role_id=24d080895b854a35950230f3ec003570)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:31.172663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:31.178554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:31.179491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:31.180377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:31.180377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:31.180377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:31.180377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:31.184243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 298/597] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:31.185108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.254329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 300/598] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:30 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/013746216dae469180f001d17ef6374e/roles/24d080895b854a35950230f3ec003570 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:31.255876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.350095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad5eb2-1737-4052-b534-aea4a9873433 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.390590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23551fa-deeb-47c3-a93d-5e678f457c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.391491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23551fa-deeb-47c3-a93d-5e678f457c27 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.391786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23551fa-deeb-47c3-a93d-5e678f457c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.392176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23551fa-deeb-47c3-a93d-5e678f457c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.401583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e336e-1c9e-4df2-bf1c-7dc5a6804003 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.405214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23551fa-deeb-47c3-a93d-5e678f457c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:31.406727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23551fa-deeb-47c3-a93d-5e678f457c27 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b23551fa-deeb-47c3-a93d-5e678f457c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:31.426256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:31.427204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:31.428090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:31.428090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:31.428090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:31.428090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:31.428090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 299/599] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:31.432965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08607bf-1348-4953-95a1-35e37f229bd8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.432965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08607bf-1348-4953-95a1-35e37f229bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.432965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08607bf-1348-4953-95a1-35e37f229bd8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.436914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 300/600] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:31.437975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08607bf-1348-4953-95a1-35e37f229bd8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.459876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181be6fe-d948-42d0-8fdc-b33b07db5e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.460977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181be6fe-d948-42d0-8fdc-b33b07db5e49 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.461499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181be6fe-d948-42d0-8fdc-b33b07db5e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.461981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181be6fe-d948-42d0-8fdc-b33b07db5e49 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.462960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181be6fe-d948-42d0-8fdc-b33b07db5e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:31.463471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181be6fe-d948-42d0-8fdc-b33b07db5e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:31.465162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181be6fe-d948-42d0-8fdc-b33b07db5e49 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:31.479182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 301/601] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:31.480068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573e2a7-78b8-47b0-94dc-c6bc3859234c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.480359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573e2a7-78b8-47b0-94dc-c6bc3859234c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.480637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573e2a7-78b8-47b0-94dc-c6bc3859234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.498574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:31.509880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8573e2a7-78b8-47b0-94dc-c6bc3859234c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:31.511277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8573e2a7-78b8-47b0-94dc-c6bc3859234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:31.523743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:31.554713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08607bf-1348-4953-95a1-35e37f229bd8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.584615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 302/602] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:31.585540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573e2a7-78b8-47b0-94dc-c6bc3859234c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.591354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.592252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.592715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.593196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.594130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:31.594645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:31.596213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:31.609046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 301/603] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:31.619195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.700826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573e2a7-78b8-47b0-94dc-c6bc3859234c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.735952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46851f-3c3a-46f6-9ab4-dc6a81294d30 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.737595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.738662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.739167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.739681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.746733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:31.748420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:31.750521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:31.763093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:31.764525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:31.765386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:31.772117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 303/604] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:31.772117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.776233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:31.778548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.780055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.780453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.780825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.790913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:31.792830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:31.810544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:31.811477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:31.812343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:31.814290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 302/605] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:31.815326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.898723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5a674-aeef-407b-8471-cce093853b2a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.948433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.949606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.949901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.950178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.953436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838acbe7-2ef1-4763-baf2-8ed2acd5298e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:31.963568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:31.974203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:31.975147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:31.976006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:31.978292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 304/606] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:31.979348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:31.995546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:31.996634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:31.997180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:31.997706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:31.998836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:31.999418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:32.001200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:32.016160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 303/607] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:32.017381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:32.050377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:32.067532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:32.116133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93de2fc-9776-453b-96dc-9d2abe3472be None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:32.144515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145a7ce-3a01-4c92-a089-848a5f6a9652 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:32.153807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:32.154842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:32.155492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:32.155973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:32.156975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:32.157492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:32.159175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:32.172238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 305/608] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:32.173344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:32.192772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:32.193443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:32.193728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:32.194020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:32.195044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:32.195350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:32.196907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:32.212337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 304/609] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:32.212337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:32.313238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0eaec-8637-44c6-9f65-87e2480c918e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:32.338441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:32.342827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:32.348776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e196ec-74fc-479a-b88d-cd29a89ca132 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:32.354443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:32.355455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:32.355840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:32.356221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/65573e15809c42a98cc3e603355df832/roles/24d080895b854a35950230f3ec003570` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:32.371569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=65573e15809c42a98cc3e603355df832, role_id=24d080895b854a35950230f3ec003570)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:32.373699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:32.385738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:32.386644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:32.386923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:32.387192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/40b920b115454a708a14a62ead99eccd/roles/24d080895b854a35950230f3ec003570` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:32.403689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=40b920b115454a708a14a62ead99eccd, role_id=24d080895b854a35950230f3ec003570)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:32.405213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:32.455506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 306/610] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:32 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/65573e15809c42a98cc3e603355df832/roles/24d080895b854a35950230f3ec003570 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:32.456724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:32.489320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 305/611] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:32 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/40b920b115454a708a14a62ead99eccd/roles/24d080895b854a35950230f3ec003570 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:32.591141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21338e-16d9-43c2-87fc-85e3f0ba9a8c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:32.637812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:32.639184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:32.639696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:32.640254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:32.653813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:32.657321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:32.689606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:32.690628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:32.691499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:32.691499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:32.691499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:32.691499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:32.693628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 307/612] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:32.699737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:32.851543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3a870-40f8-4311-9c80-0a98a8124a37 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:32.892103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:32.892770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:32.893055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:32.893331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:32.894050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:32.894406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:32.895771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:32.905744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:32.909793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 306/613] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:32.915246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:32.958876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:33.035527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0b629-77d0-4564-84e9-877e50709d0d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:33.077907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607d1a-7472-4978-9f12-3efcd785036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:33.079113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607d1a-7472-4978-9f12-3efcd785036a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.079573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607d1a-7472-4978-9f12-3efcd785036a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.080013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607d1a-7472-4978-9f12-3efcd785036a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.089767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6607d1a-7472-4978-9f12-3efcd785036a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:33.091521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6607d1a-7472-4978-9f12-3efcd785036a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-f6607d1a-7472-4978-9f12-3efcd785036a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:33.113135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:33.118929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:33.120121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:33.123228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 308/614] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:33.128673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:33.297383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8d10d-9287-4dae-a0b3-bb68a81637f9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:33.353319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:33.354409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.354889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.355172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.356104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:33.356581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:33.359603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:33.373317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fa41-07ef-4485-9c70-26e15861a42a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.373503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fa41-07ef-4485-9c70-26e15861a42a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.373793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fa41-07ef-4485-9c70-26e15861a42a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.375455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 309/615] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:33.381177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4474-0423-4599-9039-7b50f34ff306 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.381462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4474-0423-4599-9039-7b50f34ff306 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.381737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4474-0423-4599-9039-7b50f34ff306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.384320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 307/616] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 19 21:25:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:33.390280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:33.411250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-aeda4474-0423-4599-9039-7b50f34ff306 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:33.412436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-aeda4474-0423-4599-9039-7b50f34ff306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:33.505869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:33.523837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 310/617] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:25:33.551265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4474-0423-4599-9039-7b50f34ff306 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:33.571625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:33.596089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6ac2-e2d0-493e-81c8-209518431099 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:33.636854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:33.637652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.637935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.638973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.662946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:33.662946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:33.696267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4474-0423-4599-9039-7b50f34ff306 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:33.707958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:33.708888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:33.709788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:33.709788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:33.709788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:33.709788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:33.712070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 308/618] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:33.717892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:33.731976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:33.733290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.733571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.733843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.744605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:33.752576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:33.753517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:33.754389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 311/619] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:33.763175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:33.851686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448515cd-3eff-42f0-81b8-5bf7067c1d89 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:33.853375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:33.865823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:33.883804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18b0f-13f0-459f-9f74-b78c38d9da1c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:33.893178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0335c-dddb-4f53-b540-9afc769cb744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:33.893775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0335c-dddb-4f53-b540-9afc769cb744 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.894140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0335c-dddb-4f53-b540-9afc769cb744 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.894447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0335c-dddb-4f53-b540-9afc769cb744 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.895164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0335c-dddb-4f53-b540-9afc769cb744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:33.895470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0335c-dddb-4f53-b540-9afc769cb744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:33.896836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0335c-dddb-4f53-b540-9afc769cb744 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:33.910065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 309/620] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:33.911383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df9cd-5c26-4ed1-a3d6-0a85362a4b2f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.911689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df9cd-5c26-4ed1-a3d6-0a85362a4b2f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.912065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df9cd-5c26-4ed1-a3d6-0a85362a4b2f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.913321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 310/621] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:33.918163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df9cd-5c26-4ed1-a3d6-0a85362a4b2f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:33.927424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dca13-2bee-406a-9c75-5076e78e856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:33.928798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dca13-2bee-406a-9c75-5076e78e856e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.929296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dca13-2bee-406a-9c75-5076e78e856e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.929826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dca13-2bee-406a-9c75-5076e78e856e None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.931268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dca13-2bee-406a-9c75-5076e78e856e None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:33.932163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dca13-2bee-406a-9c75-5076e78e856e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:33.935320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dca13-2bee-406a-9c75-5076e78e856e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:33.946034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 312/622] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:33.947463 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec2e-9747-46e6-b702-d0c0f82892bf None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:33.947755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec2e-9747-46e6-b702-d0c0f82892bf None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:33.948084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec2e-9747-46e6-b702-d0c0f82892bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:33.967106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8211ec2e-9747-46e6-b702-d0c0f82892bf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:33.968329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8211ec2e-9747-46e6-b702-d0c0f82892bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:34.054483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 313/623] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:34.055426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211ec2e-9747-46e6-b702-d0c0f82892bf None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.066777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df9cd-5c26-4ed1-a3d6-0a85362a4b2f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.113741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.114582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.114872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.115152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.124502 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.126257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:34.140167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:34.147845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:34.148786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:34.149693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 311/624] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:34.150185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.179529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211ec2e-9747-46e6-b702-d0c0f82892bf None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.188777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:34.229740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.230613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.230904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.231181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.244761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.246402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:34.265652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0f62-ec97-4eae-a241-1ee29bfebb67 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:34.269471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:34.270363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:34.271248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:34.271248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:34.271248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:34.271248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:34.271248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 314/625] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:34.271914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.308159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.309658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.310811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.311298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.323206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:34.331497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:34.332386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:34.333212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:34.335840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 312/626] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:34.336918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.395070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a25c3-056f-4daf-afde-5069df49a42f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.422130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:34.437731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:34.442277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.442949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.443233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.443792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.444775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:34.445241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.446880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:34.449941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd386226-6276-4016-a96d-2f4733845c8c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.464267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 315/627] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:34.464267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.490535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.491223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.491510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.491788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.492513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:34.492826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.494198 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:34.507446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 313/628] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:34.508325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.620186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8b900-0dd4-41db-a13c-70bb070e19a4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.623100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b680ca-bd5e-4173-b71e-a077604cdfbb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.663629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.664556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.664844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.665132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/4af877878304440b9aa24964dedfadf1/roles/24d080895b854a35950230f3ec003570` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.671666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.672678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.673170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.674241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.675221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:34.676004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.678303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:34.680813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=4af877878304440b9aa24964dedfadf1, role_id=24d080895b854a35950230f3ec003570)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.682300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:34.693820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 316/629] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:34.693820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.743984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:34.751945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:34.758980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 314/630] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:34 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/4af877878304440b9aa24964dedfadf1/roles/24d080895b854a35950230f3ec003570 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:34.761021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.836213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250505-195e-4563-8895-a0581a721c45 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.888078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.889480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.889756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.890031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.911209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.912949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:34.920196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc41325-6849-4a7d-ac34-3ac1628567ba None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:34.943432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:34.944446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:34.945392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 317/631] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:34.950172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:34.967548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:34.968725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:34.969232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:34.969728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:34.989160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:34.991372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:35.017338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:35.018291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:35.019165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:35.019165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:35.019165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:35.019165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:35.024487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 315/632] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:35.030895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.107157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e5c-f3db-4dd1-a2bc-aa80137ee6db None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.108936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.112532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.147737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.149078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.149505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.149922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.150925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:35.151398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:35.152965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:35.182176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 318/633] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:25:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:35.187170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f437818-8992-4d9c-bde1-7bdcebb8388c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.188335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.242100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7f5d3-b9da-4a2e-9b35-22cdb7fd4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.243059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f5d3-b9da-4a2e-9b35-22cdb7fd4f34 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.243486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f5d3-b9da-4a2e-9b35-22cdb7fd4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.243905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f5d3-b9da-4a2e-9b35-22cdb7fd4f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.244885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7f5d3-b9da-4a2e-9b35-22cdb7fd4f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:35.245339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7f5d3-b9da-4a2e-9b35-22cdb7fd4f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:35.247020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7f5d3-b9da-4a2e-9b35-22cdb7fd4f34 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:35.265058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 316/634] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:35.266811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f0d4-9a9a-478c-8933-5d68218157d3 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.267332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f0d4-9a9a-478c-8933-5d68218157d3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.267777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f0d4-9a9a-478c-8933-5d68218157d3 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.269781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 317/635] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:35.270691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33f0d4-9a9a-478c-8933-5d68218157d3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.315638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1d88e-ea17-4499-b510-a36b7a9a284f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.356164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090f205-036b-4329-a515-23fe5e1d72f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.356852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f205-036b-4329-a515-23fe5e1d72f1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.357135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f205-036b-4329-a515-23fe5e1d72f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.357418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f205-036b-4329-a515-23fe5e1d72f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.385509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.393446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33f0d4-9a9a-478c-8933-5d68218157d3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.407578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.429018 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090f205-036b-4329-a515-23fe5e1d72f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:35.430509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72967990-e306-4615-b19d-ee48a622553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.430657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090f205-036b-4329-a515-23fe5e1d72f1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:35.431283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967990-e306-4615-b19d-ee48a622553b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.431566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967990-e306-4615-b19d-ee48a622553b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.431840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967990-e306-4615-b19d-ee48a622553b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.441362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72967990-e306-4615-b19d-ee48a622553b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:35.442844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72967990-e306-4615-b19d-ee48a622553b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-72967990-e306-4615-b19d-ee48a622553b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:35.457245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:35.458298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:35.459222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 318/636] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:35.460493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4d45-39b1-4a61-b11e-3ebcc67181e2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.460493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4d45-39b1-4a61-b11e-3ebcc67181e2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.460755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4d45-39b1-4a61-b11e-3ebcc67181e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.480176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5b7c4d45-39b1-4a61-b11e-3ebcc67181e2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:35.481507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5b7c4d45-39b1-4a61-b11e-3ebcc67181e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:35.549642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 319/637] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:35.549642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12d5e-5397-4cbd-ab89-39ba4302e38e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.549642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12d5e-5397-4cbd-ab89-39ba4302e38e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.549642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12d5e-5397-4cbd-ab89-39ba4302e38e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.549642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 320/638] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:35.549642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12d5e-5397-4cbd-ab89-39ba4302e38e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.562276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 319/639] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:35.562276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4d45-39b1-4a61-b11e-3ebcc67181e2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.617946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.663093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12d5e-5397-4cbd-ab89-39ba4302e38e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.673832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4d45-39b1-4a61-b11e-3ebcc67181e2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.675650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.700994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73658127-5d85-46cf-9306-b7d5f4682ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.701688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73658127-5d85-46cf-9306-b7d5f4682ffe None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.701977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73658127-5d85-46cf-9306-b7d5f4682ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.702286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73658127-5d85-46cf-9306-b7d5f4682ffe None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.703112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73658127-5d85-46cf-9306-b7d5f4682ffe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:35.703439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73658127-5d85-46cf-9306-b7d5f4682ffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:35.704880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73658127-5d85-46cf-9306-b7d5f4682ffe None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:35.711108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.712151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.712608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.713180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.723944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 321/640] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:35.724426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:35.725216 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ae55-9820-43f6-a2d9-9206a6a06e9f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.725509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ae55-9820-43f6-a2d9-9206a6a06e9f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.725785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ae55-9820-43f6-a2d9-9206a6a06e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.726680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:35.743111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ad18ae55-9820-43f6-a2d9-9206a6a06e9f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:35.744297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ad18ae55-9820-43f6-a2d9-9206a6a06e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:35.746308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:35.747228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:35.748885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:35.748885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:35.748885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:35.748885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:35.750710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 320/641] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:35.751627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.826528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 322/642] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:35.827455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ae55-9820-43f6-a2d9-9206a6a06e9f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.864147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afffc92-3708-4a49-9daa-d86ffdaab36b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.894170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.901053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.901900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.902394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.902741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:35.913290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:35.921570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:35.926545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 321/643] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:35.927696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:35.941737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:35.952508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ae55-9820-43f6-a2d9-9206a6a06e9f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:35.990003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:35.990765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:35.991268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:35.991614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.027991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4381-6799-4e08-8cdd-91af38e59ac9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.065361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.066093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.066460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.066664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.066850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.067618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:36.067989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.068124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.069480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.083520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 322/644] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:36.084428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.125335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.167485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.185197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 323/645] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:36.185197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.199153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e580-636a-42cd-8299-0455c5fc8f46 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.234723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.235603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.235956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.236306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.246657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:36.254402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:36.255495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:36.256941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 323/646] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:36.260941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.296121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094055c5-037b-4361-b6d5-0a3f3460a823 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.336403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.337576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.337872 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.338152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.339248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:36.339564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.342531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.350802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 324/647] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:36.355233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.363993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.379586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a25a8-06b2-43cf-b02a-808144d6e7cf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.416174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.417177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.417527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.417972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.420165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.425872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.427416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:36.442891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:36.443982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:36.445067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:36.445936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 324/648] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:36.446735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.464371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84262-1f8a-4671-b5c0-4d0147e48a38 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.502149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.502969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.503254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.503530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.514856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.516312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:36.533928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:36.535001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:36.536378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:36.536378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:36.536378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:36.536378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:36.536378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 325/649] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:36.536378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.564127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ed64d-69f6-447a-8d64-8c493697329b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.599744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.600335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.600620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.600898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.601639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:36.601947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.603354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.605538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.617089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 325/650] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:36.624589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.653284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50878648-24ec-4e6d-a208-04f39efb440d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.684247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.693591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.694408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.694698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.694969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.706135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.707626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:36.725440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:36.726609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:36.728004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:36.728004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:36.728004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:36.728004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:36.728004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 326/651] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:36.728004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.740320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef515b-0700-4ef1-af49-080519ceea19 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.775673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.776433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.776824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.777201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.778056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:36.778468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.780642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.797466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 326/652] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:36.797466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.843644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc7de0-41d7-42b9-b898-80fe637e45a6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.860204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.882829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.883487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.883788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.884061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.884765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:36.885069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.886452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.903085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 327/653] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:36.903085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:36.904135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d8c6f-c4a2-4e84-8442-27698069a304 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:36.921538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:36.940717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:36.941643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:36.942012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:36.942403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:36.953131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:36.954694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:36.973178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:36.974281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:36.975364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:36.975364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:36.975364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:36.975364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:36.981562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 327/654] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:36.981562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.012959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7d723-6f48-434d-88d5-d4b355d1b043 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.054347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.055121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.055417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.055696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.056416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:37.056724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.058146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.074701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 328/655] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:37.074701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.094032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b79c7-d6a9-4a20-8bfb-5ee9a5e2073b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.107593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:37.129047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.129843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.130228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.130616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.131548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=37df82be35a448bf819e4f157741b8f1) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:37.131946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.133458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.150242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 328/656] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:36 2022] GET /identity/v3/role_assignments?user.id=37df82be35a448bf819e4f157741b8f1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:37.150242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.185230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:37.198932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da5aa-7519-4adf-8667-917c50392f3e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.238911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.239725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.240010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.240287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.248572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.250073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.264300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885831a3-baaf-4ab7-b9d5-5fd39876ff00 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:37.265856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:37.266782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:37.267683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 329/657] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:37.268161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.312942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ede7b3-2526-4ce1-b785-6f97665b24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.312942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede7b3-2526-4ce1-b785-6f97665b24e3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.313268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede7b3-2526-4ce1-b785-6f97665b24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.313479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede7b3-2526-4ce1-b785-6f97665b24e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.314502 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede7b3-2526-4ce1-b785-6f97665b24e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:37.314811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede7b3-2526-4ce1-b785-6f97665b24e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.316217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede7b3-2526-4ce1-b785-6f97665b24e3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.328798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 329/658] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:37.330256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a419-7bb2-4aa6-be8b-e6a4a23af6a8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.330557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a419-7bb2-4aa6-be8b-e6a4a23af6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.330839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a419-7bb2-4aa6-be8b-e6a4a23af6a8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.334515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 330/659] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:37.334515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a419-7bb2-4aa6-be8b-e6a4a23af6a8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.392799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:37.402475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee292f1-2dd8-46cb-a343-4d69f983abcb None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.446161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.447021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.447305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.447583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.452039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:37.456031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.457489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.462151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a419-7bb2-4aa6-be8b-e6a4a23af6a8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:37.472826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:37.474007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:37.475186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 330/660] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:37.477512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.502839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e486-2524-425a-b507-8fc605e9da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.503677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e486-2524-425a-b507-8fc605e9da39 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.504061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e486-2524-425a-b507-8fc605e9da39 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.504437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e486-2524-425a-b507-8fc605e9da39 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.505339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e486-2524-425a-b507-8fc605e9da39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:37.505752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e486-2524-425a-b507-8fc605e9da39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.507403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e486-2524-425a-b507-8fc605e9da39 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.525950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 331/661] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:37.525950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0beb55-5876-4245-bd3a-684f40a1d309 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.525950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0beb55-5876-4245-bd3a-684f40a1d309 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.525950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0beb55-5876-4245-bd3a-684f40a1d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.544107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-de0beb55-5876-4245-bd3a-684f40a1d309 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:37.546047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-de0beb55-5876-4245-bd3a-684f40a1d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:37.622383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 332/662] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:37.623494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0beb55-5876-4245-bd3a-684f40a1d309 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.711933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdad0-2d03-48bb-a238-98e5ad1186d0 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.733036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:37.747417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.748219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.748735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.748861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.754845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0beb55-5876-4245-bd3a-684f40a1d309 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.756336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.757779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:37.772559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:37.773713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 331/663] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:37.779838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.792641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:37.801420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.802224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.802539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.802817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.803697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:37.804062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.805458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.828078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 333/664] 10.222.0.59 () {56 vars in 1139 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:37.828963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.880971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096e276-d8bf-4637-a4b1-ab02d7b95fe6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:37.915894 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:37.916637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:37.916987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:37.917331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:37.918299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=013746216dae469180f001d17ef6374e) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:37.918624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:37.920647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:37.934243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 332/665] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/role_assignments?user.id=013746216dae469180f001d17ef6374e&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:37.934243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:37.973581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb6c2-bd9d-4411-ab7a-412b8882beb0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.022453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.030463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.030463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.030463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.030463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.042363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.046627 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019cbe4-7e1e-441b-bca5-6dc6efb023d5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.047641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:38.057821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:38.059074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:38.060699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:38.066383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 334/666] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:38.067541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.095655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.096659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.097084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.097516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.098640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:38.099196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:38.100841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:38.124333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 333/667] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 19 21:25:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:38.125432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.208844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f979b-e923-4f0d-8b4c-f69ca44e4a29 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.249296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.249871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.250154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.250603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.254141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eaaa6-064c-43bb-ac31-9c3ba0223f1f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.303748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.304802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.305298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.305795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.306802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:38.307313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:38.308881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:38.312150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.323888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.327442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 334/668] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:38.327442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.327648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:38.328574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:38.430200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d192f42-3ff3-44a7-8032-5fe21f2a5c19 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.442897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 335/669] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:38.442897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.472578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.473469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.473904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.474383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.546336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.546986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.550306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d4192-3f5f-4425-be1e-669477c219cb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.551625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:38.554171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:38.596689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.597489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.597778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.598057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.608768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:38.610246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:38.628800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:38.629923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:38.631069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:38.631069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:38.631069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:38.631069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:38.631069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 336/670] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:38.631387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.674355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 335/671] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:38.675218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.761097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70766a0-8b3c-4b19-bd42-8d7b832d06a3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.779915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.784896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61196e2-b548-4333-a1b1-ca603f06027e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.805746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.806968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.807258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.807533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.823823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:38.824412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:38.824588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:38.824829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:38.825224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:38.826521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:38.826832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:38.827693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:38.828290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:38.842367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 336/672] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:38.843290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:38.851333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:38.852203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:38.853164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:38.853164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:38.853164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:38.853164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:38.855385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 337/673] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:38.856930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:38.868777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:38.971472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d158c-9907-4af9-8e28-a4c94d575bc6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:38.983059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691118d-a68d-403f-8d60-4ad5232d3667 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.017658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.018841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.019056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.019563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.019844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.020128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.020401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.020698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.031007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.032467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.035807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.037259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:39.051217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:39.052169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:39.053094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:39.054533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 338/674] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:39.055351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:39.061225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:39.062117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:39.063040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:39.063040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:39.063040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:39.063040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:39.066386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 337/675] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:39.066386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.082794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.145239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.177505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fcac5-2c64-4c02-aa8e-2af0caf90c3e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.196718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331a314-1886-4135-888c-33e758d3d13a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.219574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.220276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.220563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.220845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.221815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:39.222119 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.223815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.247356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.248449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 338/676] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:39.248725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.249210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.249384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.249961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.250934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:39.251447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.254370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.276016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 339/677] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:39.276016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.348652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.404538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2dbd6-8e16-4043-a9f1-a97ed76542db None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.421816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886bc8-617d-44da-a87a-1a6f287d11a3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.447232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.453048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.454397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.454868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.455567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.456723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:39.457283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.460774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.460930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.460930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.460930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.460930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.475111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 339/678] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:39.476272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.542654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.544154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.589617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6517f-425b-4dc1-8b8b-b7784cc3fdf4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.617377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.626711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817d503-ee39-4a82-b68d-619836634ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.627511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817d503-ee39-4a82-b68d-619836634ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.627796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817d503-ee39-4a82-b68d-619836634ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.629865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817d503-ee39-4a82-b68d-619836634ad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.635769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817d503-ee39-4a82-b68d-619836634ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.637380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817d503-ee39-4a82-b68d-619836634ad1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.649095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 340/679] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:39.650549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-3817d503-ee39-4a82-b68d-619836634ad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:39.652177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:39.653239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:39.654771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:39.660461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 340/680] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:39.661679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2e09-5610-413b-b91f-9256e240fb7b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.661967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2e09-5610-413b-b91f-9256e240fb7b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.662547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2e09-5610-413b-b91f-9256e240fb7b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.663798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 341/681] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:39.668629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f2e09-5610-413b-b91f-9256e240fb7b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.685572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.769231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf8df0-e7c4-4071-a95f-d67dcd75c4f3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.782701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f2e09-5610-413b-b91f-9256e240fb7b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.807262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.808053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.808343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.808629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.815881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.817325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.820844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ae38c-1cd3-485e-a33c-f0b82edc6e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.821854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae38c-1cd3-485e-a33c-f0b82edc6e24 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.822452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae38c-1cd3-485e-a33c-f0b82edc6e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.822907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae38c-1cd3-485e-a33c-f0b82edc6e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:39.831085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:39.832108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:39.833005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:39.834921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ae38c-1cd3-485e-a33c-f0b82edc6e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.836378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ae38c-1cd3-485e-a33c-f0b82edc6e24 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:39.836945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 341/682] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:39.837678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-061ae38c-1cd3-485e-a33c-f0b82edc6e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:39.859896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:39.860861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 342/683] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3b14-57de-473d-b2e7-962dc71dab5e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3b14-57de-473d-b2e7-962dc71dab5e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.866530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3b14-57de-473d-b2e7-962dc71dab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.885138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-373f3b14-57de-473d-b2e7-962dc71dab5e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:39.886677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-373f3b14-57de-473d-b2e7-962dc71dab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:39.928230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.929562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:39.945144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b10a4-be3f-458d-b57f-9557358bdd3d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:39.962489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 343/684] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:39.963339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f3b14-57de-473d-b2e7-962dc71dab5e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:39.993447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:39.994427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:39.994720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:39.995003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:39.995826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:39.996143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:39.997615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.013889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 342/685] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.013889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.073906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f3b14-57de-473d-b2e7-962dc71dab5e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.111776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.111968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082adcc1-9dea-4faf-90e3-6ee56e53bb23 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.112443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.112728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.113008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.113913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:40.114372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.115815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.132619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 344/686] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.132619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.155883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.156477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.157012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.157301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.158045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:40.158405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.159836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.171608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:40.175524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 343/687] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.175524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.179074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:40.249074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7554c-60cf-48aa-811d-f5262e6264cc None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.277875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b82f-0f87-4115-ab8f-50e4e915f64d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.285554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.287066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.287521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.287795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.299686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:40.307379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:40.308270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:40.309097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 345/688] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:40.309861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.324740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.325930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.326259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.326523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.327391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=40b920b115454a708a14a62ead99eccd) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:40.327708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.329153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.335329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 344/689] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/role_assignments?user.id=40b920b115454a708a14a62ead99eccd&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.336024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.412265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:40.416747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:40.424306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20b24-83e6-4b58-9c94-f38134386767 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.454157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90d117-f995-4ef8-a3ad-2f8703cc03b8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.467389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.468063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.468368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.468631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.469472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=65573e15809c42a98cc3e603355df832) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:40.469783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.471387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.478703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 346/690] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/role_assignments?user.id=65573e15809c42a98cc3e603355df832&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.491302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.492773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577f8c-3eb5-4925-a7e2-3b9601bea48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.493612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577f8c-3eb5-4925-a7e2-3b9601bea48e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.493900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577f8c-3eb5-4925-a7e2-3b9601bea48e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.494182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577f8c-3eb5-4925-a7e2-3b9601bea48e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.504196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577f8c-3eb5-4925-a7e2-3b9601bea48e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.505744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577f8c-3eb5-4925-a7e2-3b9601bea48e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c4577f8c-3eb5-4925-a7e2-3b9601bea48e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:40.523693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:40.524652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:40.525526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 345/691] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:40.532533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7f09-7c08-45b0-8584-838e915387d5 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.532533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7f09-7c08-45b0-8584-838e915387d5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.532533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7f09-7c08-45b0-8584-838e915387d5 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.536098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 346/692] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:40.536098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e7f09-7c08-45b0-8584-838e915387d5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.635938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5405e9-681e-4a29-a4ae-748341e74799 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.674780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e7f09-7c08-45b0-8584-838e915387d5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.685961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594c424-e632-471f-9084-49e2c3176f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.687003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594c424-e632-471f-9084-49e2c3176f2c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.687510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594c424-e632-471f-9084-49e2c3176f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.687988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594c424-e632-471f-9084-49e2c3176f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.689193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594c424-e632-471f-9084-49e2c3176f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:40.689719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594c424-e632-471f-9084-49e2c3176f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.691912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594c424-e632-471f-9084-49e2c3176f2c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.701325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 347/693] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.702981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705197-f8cf-42e1-b6e3-c11db481184f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.703482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705197-f8cf-42e1-b6e3-c11db481184f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.703962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705197-f8cf-42e1-b6e3-c11db481184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.710697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:40.721599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.722247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.722540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.722731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-cb705197-f8cf-42e1-b6e3-c11db481184f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:40.725235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.725235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:40.725235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.725476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cb705197-f8cf-42e1-b6e3-c11db481184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:40.725559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.737954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:40.741311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 347/694] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.742022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.806359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 348/695] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:40.807292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705197-f8cf-42e1-b6e3-c11db481184f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.857952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ac9ce-cee1-4228-9899-cc5a247922de None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.896953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.898302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.898599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.898888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.911546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.913216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.927615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705197-f8cf-42e1-b6e3-c11db481184f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:40.931945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:40.932967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:40.933844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:40.933844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:40.933844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:40.933844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:40.934390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 348/696] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:40.935693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.963636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:40.964298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:40.964587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:40.964865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:40.965699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=4af877878304440b9aa24964dedfadf1) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:40.966623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:40.968122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:40.975218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 349/697] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/role_assignments?user.id=4af877878304440b9aa24964dedfadf1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:40.976207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:40.991514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:40.995955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:41.062344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ee17-b190-4b71-a401-f71a45b622e2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:41.120742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53591-6bca-4a63-8eec-ff5a9425f2f4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:41.155051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:41.155869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:41.156152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:41.156435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:41.164979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:41.165975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:41.166282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:41.166562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:41.167294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:41.167681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:41.169039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:41.182364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:41.183728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 350/698] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:41.183855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:41.192627 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:41.226939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:41.227869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:41.228746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:41.228746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:41.228746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:41.228746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:41.233102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 349/699] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:41.234485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:41.318127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:41.355592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532655d1-d25c-4566-b326-16880e8d0ff8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:41.391698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:41.395108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:41.395960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:41.396188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:41.396454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:41.402999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9354-5e5f-4f82-8cdc-1dfb282d2c5b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:41.406356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:41.412412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:41.432075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:41.433092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:41.434408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 351/700] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:25:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:41.441088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:41.450233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:41.451428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:41.451707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:41.451976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:41.452696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:41.453000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:41.454409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:41.470317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 350/701] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:41.475841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:41.584373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a5ca-fa22-4e87-ab79-e79bad4cecbd None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:41.600536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765c711-4da7-4db8-a410-95f06dcd4667 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:41.616178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:41.623163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:41.624197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:41.624722 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:41.625202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:41.626443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:41.630820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:41.630820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:41.637648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:41.638370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:41.638650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:41.638922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:41.640160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:41.641031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:41.648871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 352/702] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:25:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:41.656570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:41.736934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 351/703] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:25:41 2022] POST /identity/v3/users => generated 254 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:41.787179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460cc47-aee3-40ed-9c5f-8108c9ceb563 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:41.839454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:41.840127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:41.840407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:41.840689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:41.922861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:41.942304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:41.943790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:42.074851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 353/704] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:42.079898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:42.092585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:42.197637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848803b-339f-49cd-bc09-3dea2155af03 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:42.233875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:42.234692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:42.235028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:42.235314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:42.246045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:42.247558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:42.266685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:42.267613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:42.268558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:42.268558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:42.268558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:42.268558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:42.274663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 352/705] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:42.275643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:42.450076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:42.462467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871456-fe95-4c29-aff4-4411e8488ee1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:42.506823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:42.507493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:42.507775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:42.508050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:42.508774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:42.509077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:42.510525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:42.524824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 354/706] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:42.531647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:42.702706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:42.722936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789592e0-398c-4b58-9ec7-f726c9f364ec None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:42.803063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:42.803968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:42.804140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:42.804414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:42.819373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:42.820854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:42.842418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:42.843440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:42.844343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 353/707] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:42.849292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:43.015867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141189a3-6e66-48ec-afea-ed357e9669b5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:43.084540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e267a-7a5b-4585-854c-97b866b090cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:43.085216 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e267a-7a5b-4585-854c-97b866b090cd None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.085506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e267a-7a5b-4585-854c-97b866b090cd None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.085785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e267a-7a5b-4585-854c-97b866b090cd None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.086606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e267a-7a5b-4585-854c-97b866b090cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:43.086922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e267a-7a5b-4585-854c-97b866b090cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:43.088425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e267a-7a5b-4585-854c-97b866b090cd None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:43.112595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 355/708] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:43.118702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:43.232585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02db8-c9cc-42dc-9169-af976b3346db None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.232878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02db8-c9cc-42dc-9169-af976b3346db None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.233166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02db8-c9cc-42dc-9169-af976b3346db None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.234724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 356/709] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:25:43.244829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5b30-b94f-45fc-aef0-192317bd872b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.245126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5b30-b94f-45fc-aef0-192317bd872b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.245396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5b30-b94f-45fc-aef0-192317bd872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.266786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-81ad5b30-b94f-45fc-aef0-192317bd872b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:43.267896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-81ad5b30-b94f-45fc-aef0-192317bd872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:43.269982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:43.302359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6433523-7d08-428c-9557-a66c559a04a2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:43.334566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:43.366915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da0781-d54b-402a-b173-d7d45c957e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:43.368373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0781-d54b-402a-b173-d7d45c957e97 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.368668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0781-d54b-402a-b173-d7d45c957e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.368946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0781-d54b-402a-b173-d7d45c957e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.369797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da0781-d54b-402a-b173-d7d45c957e97 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=37df82be35a448bf819e4f157741b8f1) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:43.370111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da0781-d54b-402a-b173-d7d45c957e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:43.371675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da0781-d54b-402a-b173-d7d45c957e97 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:43.378962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 354/710] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:43 2022] GET /identity/v3/role_assignments?user.id=37df82be35a448bf819e4f157741b8f1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:43.380384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2023b9f-7968-4b76-8605-567b60f8898e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.380680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2023b9f-7968-4b76-8605-567b60f8898e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.380959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2023b9f-7968-4b76-8605-567b60f8898e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.382524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 355/711] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:43.395860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a31ba-5afa-405f-9b1a-f78ee95407cc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.396308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a31ba-5afa-405f-9b1a-f78ee95407cc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.396682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a31ba-5afa-405f-9b1a-f78ee95407cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.405102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 357/712] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:43.418817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-346a31ba-5afa-405f-9b1a-f78ee95407cc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:43.420445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-346a31ba-5afa-405f-9b1a-f78ee95407cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:43.451039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5b30-b94f-45fc-aef0-192317bd872b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:43.568826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 356/713] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:43.594124 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a31ba-5afa-405f-9b1a-f78ee95407cc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:43.636519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5b30-b94f-45fc-aef0-192317bd872b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:43.682933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:43.683808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.684037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.684317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.685019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:43.686424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:43.701581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a31ba-5afa-405f-9b1a-f78ee95407cc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:43.712159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:43.713149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:43.714064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 358/714] 10.222.0.59 () {56 vars in 1129 bytes} [Thu May 19 21:25:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:43.719938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:43.721059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:43.728770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:43.745520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:43.746686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.747236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.747734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] PATH_INFO: `/v3/services/network` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.748632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:43.750296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:43.766061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:43.767146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:43.767962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:43.772126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 357/715] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:43 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:43.779132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:43.888845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922293f-a4ec-4fda-bd85-c7fe140a93be None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:43.922485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847a5ef-6155-46df-97f5-d73cbdacbeed None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:43.926025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:43.926948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.927439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.927919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.928832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] RBAC: Adding query filter params (name=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:43.929361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:43.930967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:43.936397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 358/716] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:25:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:43.942331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:43.968135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf3170-f9a3-4df9-9bf6-9f9ca9a3badf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:43.968805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3170-f9a3-4df9-9bf6-9f9ca9a3badf None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.969148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3170-f9a3-4df9-9bf6-9f9ca9a3badf None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.969362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3170-f9a3-4df9-9bf6-9f9ca9a3badf None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.970069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3170-f9a3-4df9-9bf6-9f9ca9a3badf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:43.970403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3170-f9a3-4df9-9bf6-9f9ca9a3badf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:43.971780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3170-f9a3-4df9-9bf6-9f9ca9a3badf None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:43.986681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 359/717] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 19 21:25:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:43.990625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a8a6-c5f6-46cf-aee8-7a2710e4dd88 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:43.991157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a8a6-c5f6-46cf-aee8-7a2710e4dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:43.991734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a8a6-c5f6-46cf-aee8-7a2710e4dd88 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:43.993021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 360/718] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:25:43.993631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:43.993743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a8a6-c5f6-46cf-aee8-7a2710e4dd88 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:44.058487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc740def-31c0-4a4f-b240-c8927af1e123 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:44.068673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:44.097638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874fc1b-560a-4b06-82e0-279e1dfe6848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:44.098791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874fc1b-560a-4b06-82e0-279e1dfe6848 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.099372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874fc1b-560a-4b06-82e0-279e1dfe6848 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.099890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874fc1b-560a-4b06-82e0-279e1dfe6848 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.100801 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874fc1b-560a-4b06-82e0-279e1dfe6848 None admin] RBAC: Adding query filter params (type=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:44.101317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874fc1b-560a-4b06-82e0-279e1dfe6848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:44.102942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874fc1b-560a-4b06-82e0-279e1dfe6848 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:44.108161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a8a6-c5f6-46cf-aee8-7a2710e4dd88 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:44.114636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 359/719] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:25:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:44.116459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0edf9-eb41-4cec-b5d6-975d6acdb6d4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.116980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0edf9-eb41-4cec-b5d6-975d6acdb6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.117497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0edf9-eb41-4cec-b5d6-975d6acdb6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.146198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:44.146826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.147113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.147390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.148099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:44.148427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:44.153332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:44.155058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-52e0edf9-eb41-4cec-b5d6-975d6acdb6d4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:44.156559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-52e0edf9-eb41-4cec-b5d6-975d6acdb6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:44.157196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 361/720] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 19 21:25:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:44.270283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 360/721] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:44.296317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:44.444213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627216e-e766-4fe3-9bd7-4d11f4a71bfd None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:44.477370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:44.483700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804576e-a967-4456-a3e3-056816b04d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:44.484675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804576e-a967-4456-a3e3-056816b04d86 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.485060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804576e-a967-4456-a3e3-056816b04d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.485438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804576e-a967-4456-a3e3-056816b04d86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.499039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804576e-a967-4456-a3e3-056816b04d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-b804576e-a967-4456-a3e3-056816b04d86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:44.506844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:44.507939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:44.508971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:44.511050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 362/722] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:44.517413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0edf9-eb41-4cec-b5d6-975d6acdb6d4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:44.561458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:44.657717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0edf9-eb41-4cec-b5d6-975d6acdb6d4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:44.675845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488670-9418-493a-b169-7260cdbf62c3 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.676283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488670-9418-493a-b169-7260cdbf62c3 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.676688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488670-9418-493a-b169-7260cdbf62c3 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.678459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 363/723] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:44.688257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b7f64-8fdb-4902-a624-e6b80f371af5 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.688911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b7f64-8fdb-4902-a624-e6b80f371af5 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.689510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b7f64-8fdb-4902-a624-e6b80f371af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.698093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:44.699171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.699638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.700195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.701127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:44.701699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:44.703313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:44.713367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 361/724] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:44.720694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:44.734444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-401b7f64-8fdb-4902-a624-e6b80f371af5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:44.735850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-401b7f64-8fdb-4902-a624-e6b80f371af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:44.839784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 364/725] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:44.863167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b7f64-8fdb-4902-a624-e6b80f371af5 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:44.889957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:44.896339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851d8c-7004-40ba-a437-f71e76d85da0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:44.967993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:44.968706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:44.968989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:44.969278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:44.988823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:44.990641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:45.020751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:45.021767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:45.022663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:45.022663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:45.022663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:45.022663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:45.026296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 362/726] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:45.033111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:45.068489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b7f64-8fdb-4902-a624-e6b80f371af5 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:45.096975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:45.112709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:45.113518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.113800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.114074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.125537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:45.133647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:45.137775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:45.138686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 365/727] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:45.143981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:45.203224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0b5f-d5ae-44b6-aeb1-99dfb3694e4c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:45.251088 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:45.251676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.251956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.252229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.252956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:45.253261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:45.254667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:45.278727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 363/728] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:45.284199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:45.311942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:45.343411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463eb23-2adf-4320-bac4-f64f15917593 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:45.396306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:45.397059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.397351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.397630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.398427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:45.398739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:45.400233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:45.409848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 366/729] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:45.414927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:45.484795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:45.490739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc9d0-50c1-4111-9350-18b15fe20817 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:45.548866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:45.550132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.550762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.551939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.565393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:45.567207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:45.588067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:45.589058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:45.590015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:45.599935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63014-b37c-4257-9f79-0a5bae4a6806 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:45.603433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 364/730] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:45.613385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:45.666041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:45.667423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.668777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.669998 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.696146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:45.698092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:45.731308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:45.732805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:45.733711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:45.733711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:45.733711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:45.733711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:45.736469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 367/731] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:45.743448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:45.758251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:45.817554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72810-2b25-4eed-bf79-d45d86e19893 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:45.887334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:45.888402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.888895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.889377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.890464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:45.891680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:45.894944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:45.920599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 365/732] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:45.923214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:45.926201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:45.934284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04c96a-b6af-4036-b4c9-690f284a6560 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:45.976128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12836d32-1ffa-413c-9270-192e3d3eb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:45.977146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12836d32-1ffa-413c-9270-192e3d3eb4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.977638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12836d32-1ffa-413c-9270-192e3d3eb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.978118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12836d32-1ffa-413c-9270-192e3d3eb4d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.979097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12836d32-1ffa-413c-9270-192e3d3eb4d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:45.979613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12836d32-1ffa-413c-9270-192e3d3eb4d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:45.981233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12836d32-1ffa-413c-9270-192e3d3eb4d7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:45.994738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 368/733] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:45.996499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d72b93-a4e0-4e16-86de-e36fd3882d3e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:45.997038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d72b93-a4e0-4e16-86de-e36fd3882d3e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:45.997520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d72b93-a4e0-4e16-86de-e36fd3882d3e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:45.999592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 369/734] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:46.000495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d72b93-a4e0-4e16-86de-e36fd3882d3e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.074646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5afe18-8012-4959-be5c-09734386c274 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:46.108488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:46.112781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d72b93-a4e0-4e16-86de-e36fd3882d3e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:46.118464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:46.119113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.119404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.119686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.153967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b8a4-eae3-4fa1-ba5a-52f1498c2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:46.155281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b8a4-eae3-4fa1-ba5a-52f1498c2b45 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.155771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b8a4-eae3-4fa1-ba5a-52f1498c2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.156270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b8a4-eae3-4fa1-ba5a-52f1498c2b45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.164711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03b8a4-eae3-4fa1-ba5a-52f1498c2b45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:46.167531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03b8a4-eae3-4fa1-ba5a-52f1498c2b45 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-1e03b8a4-eae3-4fa1-ba5a-52f1498c2b45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:46.184901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:46.185895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:25:46.186878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:46.189915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 370/735] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:46.191777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc4cf-4822-4ee3-83a7-7d0413def649 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.192274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc4cf-4822-4ee3-83a7-7d0413def649 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.192754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc4cf-4822-4ee3-83a7-7d0413def649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.197536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:46.199315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:46.212029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9f3cc4cf-4822-4ee3-83a7-7d0413def649 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:46.213812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9f3cc4cf-4822-4ee3-83a7-7d0413def649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:46.225353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:46.298351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 371/736] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:46.299620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc4cf-4822-4ee3-83a7-7d0413def649 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.344211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 366/737] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:46.344211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.375929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:46.441277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc4cf-4822-4ee3-83a7-7d0413def649 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:46.472683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403b292-791d-4aba-a50d-183a8e6ee833 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:46.478985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:46.479943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.480436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.480968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.482036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:46.482584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:46.484400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:46.506192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 372/738] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 19 21:25:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:46.507365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.512417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:46.513495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:46.514646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.515101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.515527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.527152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:46.538102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:46.539279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:46.540357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:46.544411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 367/739] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:46.545602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.641689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88bdd1-2a62-4b43-a1c0-7703a982c94a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:46.682490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:46.683565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.683804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e5776-4605-4328-b312-4c3f6c218aa6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:46.684202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.684735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.696227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:46.698079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:46.710621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:46.718074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:46.719153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:46.720244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:46.720244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:46.720244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:46.720244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:46.720598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca546-de90-4dbc-b505-ec070d076c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:46.721337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca546-de90-4dbc-b505-ec070d076c58 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.721727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca546-de90-4dbc-b505-ec070d076c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.722080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca546-de90-4dbc-b505-ec070d076c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.726973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 373/740] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:46.727718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.794625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:46.809937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca546-de90-4dbc-b505-ec070d076c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:46.811512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca546-de90-4dbc-b505-ec070d076c58 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:46.840330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412dec4-df3c-4a93-99da-9308fdfa2a56 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:46.873695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:46.874382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.874668 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.874945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.875678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:46.875983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:46.877347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:46.885174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 374/741] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:46.885948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.900449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:46.913641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 368/742] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:25:46.915092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fd81d-457a-49e9-88d5-eb7c0dbca5a2 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.915339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fd81d-457a-49e9-88d5-eb7c0dbca5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.915580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fd81d-457a-49e9-88d5-eb7c0dbca5a2 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.916824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 369/743] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:46.917964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182074-0ba9-4c01-8a55-89064e566e29 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:46.918319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182074-0ba9-4c01-8a55-89064e566e29 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:46.918613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182074-0ba9-4c01-8a55-89064e566e29 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:46.919999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 370/744] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:46.920616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50182074-0ba9-4c01-8a55-89064e566e29 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:46.985224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11fb37-3dee-494d-9851-63cde286f5b3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.001047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:47.018596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.019254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.019539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.019816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.020532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:47.020841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.020991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50182074-0ba9-4c01-8a55-89064e566e29 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.022473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.034438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 375/745] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:47.035225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.059409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6f6ed-bdd6-4bd2-9da1-7b797b08802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.060187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6f6ed-bdd6-4bd2-9da1-7b797b08802c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.060481 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6f6ed-bdd6-4bd2-9da1-7b797b08802c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.060745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6f6ed-bdd6-4bd2-9da1-7b797b08802c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.070800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6f6ed-bdd6-4bd2-9da1-7b797b08802c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.072221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6f6ed-bdd6-4bd2-9da1-7b797b08802c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-dab6f6ed-bdd6-4bd2-9da1-7b797b08802c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:47.089754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:47.091485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:47.092380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:47.092380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:47.092380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:47.092380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:47.092380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 371/746] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:47.093045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356623-2519-4f64-9d68-bc7069859762 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.093327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356623-2519-4f64-9d68-bc7069859762 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.093602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356623-2519-4f64-9d68-bc7069859762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.109702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6c356623-2519-4f64-9d68-bc7069859762 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:47.110946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6c356623-2519-4f64-9d68-bc7069859762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:47.136490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084ce78-f4b9-4d6b-9907-ba2c91708df3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.145029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:47.170004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.171004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.171451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.171734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.175892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 372/747] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:47.177214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da92c-6e62-4f57-b85c-02ab4eb56571 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.177505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da92c-6e62-4f57-b85c-02ab4eb56571 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.177780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da92c-6e62-4f57-b85c-02ab4eb56571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.181643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.183123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:47.201925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:47.203005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:47.204089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:47.204089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:47.204089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:47.204089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:47.204089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 376/748] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:47.204089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.217814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d94da92c-6e62-4f57-b85c-02ab4eb56571 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:47.219031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d94da92c-6e62-4f57-b85c-02ab4eb56571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:47.230948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:47.286047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 373/749] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:25:47.286945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94da92c-6e62-4f57-b85c-02ab4eb56571 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.310934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398041-44f9-4cec-a265-6dee7a206db8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.346748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.347644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.347930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.348198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.354776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.356243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:47.369681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:47.370741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 377/750] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:47.371630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.385315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:47.388704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94da92c-6e62-4f57-b85c-02ab4eb56571 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.423306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.423898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.424185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.424478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.425195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:47.425508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.426912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.440755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 374/751] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:47.441734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.465024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:47.479709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3249dc-7dee-4785-a41c-36a89452253b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.514618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.515271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.515556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.515835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.516555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.517935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.582970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed29b-6725-4e0d-b87e-8ff7692d23e2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.615569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.616326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.616503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.616779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.617494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:47.617802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.619221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.620920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 378/752] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:25:47 2022] POST /identity/v3/services => generated 240 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:47.621811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.755583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 375/753] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:47.756358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.766807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ad44-c42f-490b-8bf1-87e2f7ca5c1c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.780928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:47.812440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.813696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.814153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.814528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.815205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.816671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.876085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1940d-37b8-4980-b32a-c0c6faf170ef None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:47.889727 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 379/754] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:25:47 2022] POST /identity/v3/services => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:47.902403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:47.902403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:47.931544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:47.932330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:47.932613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:47.932972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:47.933726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:47.934037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:47.935599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:47.951093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 376/755] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:47.952170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.033331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391b49-62fd-4dce-a306-c2ec142c4d71 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.046458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:48.073152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.074084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b99fb0-4ee1-4efb-8dbc-e4a3fa2397b8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.075503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.075503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.076085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.088938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.090481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:48.107664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:48.108641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:48.109669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 380/756] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:25:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:48.111109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.124983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.125768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.126061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.126380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.136664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.138743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:48.153286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:48.154200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:48.155161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:48.155582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 377/757] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:48.159668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.203339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:48.249334 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008928f0-51ce-45a2-b9ed-7e41434ffa3c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.279098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fc61c-7379-4a3d-a341-c622ebc0e17f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.295328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.296105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.296548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.296926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.297768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=4af877878304440b9aa24964dedfadf1) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:48.298078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.299557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.306380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 381/758] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:48 2022] GET /identity/v3/role_assignments?user.id=4af877878304440b9aa24964dedfadf1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:48.307197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.316156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.316853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.317132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.317409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.318339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:48.318739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.320236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.323574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:48.341437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 378/759] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:25:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:48.346391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.424842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4094f-455a-4a8f-9ea1-baadd75bec26 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.456187 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:48.459970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6dfcf-1df4-4e8b-95f3-cb17afeeb0fc None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.465244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.466788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.467226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.471621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.471621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:48.471621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.471621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.491494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 382/760] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:48.497743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.506362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.507352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.507876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.508218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.526264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.529552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:48.562775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:48.563961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:48.564855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:48.564855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:48.564855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:48.564855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:48.565998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 379/761] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:48.570549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.658059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7289f-b6aa-4275-b521-01410a809f9f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.674349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:48.705479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.706562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.707083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.707802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.709759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=13b68cce32bf48c283ea53cb65f4e1b6) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:48.710315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.712149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.719691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 383/762] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:48 2022] GET /identity/v3/role_assignments?user.id=13b68cce32bf48c283ea53cb65f4e1b6&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:48.759463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070744e-442c-470e-84a1-5e1775630e6a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:48.826738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:48.829003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:48.829003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:48.829003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:48.829003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:48.829003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:48.830588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:48.858784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 380/763] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:48.864259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:48.954588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:49.009939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991db7-ef35-4401-a268-54c2c396c25f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:49.069323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:49.070487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:49.070978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:49.071440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:49.079772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:49.081428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:49.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:49.099136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:49.100019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:49.106275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 384/764] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:49.111311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:49.296253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f635d9f-d655-4ec1-8d30-c32226f576a7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:49.306713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:49.340343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35508cbc-4aae-4520-a578-3ce859c42c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:49.340965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508cbc-4aae-4520-a578-3ce859c42c5c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:49.342519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508cbc-4aae-4520-a578-3ce859c42c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:49.342829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508cbc-4aae-4520-a578-3ce859c42c5c None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:49.343645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35508cbc-4aae-4520-a578-3ce859c42c5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:49.343959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35508cbc-4aae-4520-a578-3ce859c42c5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:49.345411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35508cbc-4aae-4520-a578-3ce859c42c5c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:49.365433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 381/765] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:49.371066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:49.496351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24a657-a1a6-40ad-90f0-855078e1b97c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:49.509840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:49.534016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e8778-afa4-4cbf-a89b-d9b099d6c46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:49.534946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e8778-afa4-4cbf-a89b-d9b099d6c46a None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:49.535234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e8778-afa4-4cbf-a89b-d9b099d6c46a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:49.535514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e8778-afa4-4cbf-a89b-d9b099d6c46a None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/37df82be35a448bf819e4f157741b8f1/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:49.537490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e8778-afa4-4cbf-a89b-d9b099d6c46a None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=37df82be35a448bf819e4f157741b8f1, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:49.538960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e8778-afa4-4cbf-a89b-d9b099d6c46a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:49.624135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 385/766] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:49 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/37df82be35a448bf819e4f157741b8f1/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:50.507132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd977a-2c43-4007-8d56-8209f26cb80c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:50.508033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd977a-2c43-4007-8d56-8209f26cb80c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:50.508503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd977a-2c43-4007-8d56-8209f26cb80c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:50.510324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 382/767] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:50.516363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02bd6-63ff-4a07-85b9-b35126cd4450 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:50.517163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02bd6-63ff-4a07-85b9-b35126cd4450 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:50.517618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02bd6-63ff-4a07-85b9-b35126cd4450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:50.536737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea885-a6f8-4073-9947-8750086e694e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:50.537301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea885-a6f8-4073-9947-8750086e694e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:50.537766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea885-a6f8-4073-9947-8750086e694e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:50.539319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 383/768] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:25:50.544425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad778-8320-4273-9532-428a4952d9bf None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:50.544906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad778-8320-4273-9532-428a4952d9bf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:50.545382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad778-8320-4273-9532-428a4952d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:50.553257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7dd02bd6-63ff-4a07-85b9-b35126cd4450 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:50.555471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7dd02bd6-63ff-4a07-85b9-b35126cd4450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:50.573129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a0dad778-8320-4273-9532-428a4952d9bf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:50.575320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a0dad778-8320-4273-9532-428a4952d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:50.669832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 384/769] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:25:50.694924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad778-8320-4273-9532-428a4952d9bf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:50.729479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 386/770] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:50.750031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02bd6-63ff-4a07-85b9-b35126cd4450 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:50.858312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:50.865996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad778-8320-4273-9532-428a4952d9bf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:50.903531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:50.904780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:50.905284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:50.905762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] PATH_INFO: `/v3/services/network` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:50.906636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:50.908227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:50.920389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:50.921358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:50.922159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:50.924934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 385/771] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:50 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:50.932681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:50.974237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02bd6-63ff-4a07-85b9-b35126cd4450 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:50.974237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:51.013795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.014567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.014855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.015133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.015792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.017174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:51.034281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:51.035220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:51.036039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:51.052487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 387/772] 10.222.0.59 () {56 vars in 1129 bytes} [Thu May 19 21:25:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:51.060737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.098949 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01bd8-9476-44f2-a672-2e73ec183344 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.135805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29dbc1-009d-40fd-aedd-e0544b7e0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.136569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29dbc1-009d-40fd-aedd-e0544b7e0847 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.136862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29dbc1-009d-40fd-aedd-e0544b7e0847 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.138466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29dbc1-009d-40fd-aedd-e0544b7e0847 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.138646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29dbc1-009d-40fd-aedd-e0544b7e0847 None admin] RBAC: Adding query filter params (name=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:51.138928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29dbc1-009d-40fd-aedd-e0544b7e0847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.140506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29dbc1-009d-40fd-aedd-e0544b7e0847 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.146005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 386/773] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:25:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:51.147616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccf50b-abc7-48e6-a3ee-92f7f103b335 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.147906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccf50b-abc7-48e6-a3ee-92f7f103b335 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.148186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccf50b-abc7-48e6-a3ee-92f7f103b335 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.152982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 387/774] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:51.153918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccf50b-abc7-48e6-a3ee-92f7f103b335 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.190043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:51.192994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe7547-344f-4286-991b-42deef2cef6a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.233036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cdf16-bd23-4165-93ae-6e953f2a3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.234252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdf16-bd23-4165-93ae-6e953f2a3d68 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.234966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdf16-bd23-4165-93ae-6e953f2a3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.235415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdf16-bd23-4165-93ae-6e953f2a3d68 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.236980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cdf16-bd23-4165-93ae-6e953f2a3d68 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:51.237438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cdf16-bd23-4165-93ae-6e953f2a3d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.239274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cdf16-bd23-4165-93ae-6e953f2a3d68 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.246477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 388/775] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:51.248475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4c85-cf9b-4c72-8aaa-be007bb5b619 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.248914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4c85-cf9b-4c72-8aaa-be007bb5b619 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.249355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4c85-cf9b-4c72-8aaa-be007bb5b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.270377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-79ff4c85-cf9b-4c72-8aaa-be007bb5b619 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:51.272605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-79ff4c85-cf9b-4c72-8aaa-be007bb5b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:51.287960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccf50b-abc7-48e6-a3ee-92f7f103b335 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.308118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:51.332762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.333678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.334034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.334416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.335223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:51.335605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.337787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.349804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 388/776] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:51.349804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.381753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 389/777] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:51.381753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4c85-cf9b-4c72-8aaa-be007bb5b619 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.480467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:51.496764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4916c-a413-47bc-a9c6-700ea003a9a8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.510770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4c85-cf9b-4c72-8aaa-be007bb5b619 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.539657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.540938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.541218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.541509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.542231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:51.542552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.543969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.549123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 389/778] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:51.549912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.555386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352c6d5-09a0-4de3-9e53-ca9e220942d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.556235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352c6d5-09a0-4de3-9e53-ca9e220942d6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.556525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352c6d5-09a0-4de3-9e53-ca9e220942d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.557642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352c6d5-09a0-4de3-9e53-ca9e220942d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.558482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352c6d5-09a0-4de3-9e53-ca9e220942d6 None admin] RBAC: Adding query filter params (interface=public, service_id=c484801d98954b5f8a750ad24c0ca44d, region_id=RegionOne) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:51.558807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352c6d5-09a0-4de3-9e53-ca9e220942d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.560255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352c6d5-09a0-4de3-9e53-ca9e220942d6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.573324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 390/779] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/endpoints?service_id=c484801d98954b5f8a750ad24c0ca44d&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:51.573324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32925-abc9-42b4-8053-79f8a088a4cb None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.573324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32925-abc9-42b4-8053-79f8a088a4cb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.573324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32925-abc9-42b4-8053-79f8a088a4cb None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.573324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 391/780] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:51.577658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32925-abc9-42b4-8053-79f8a088a4cb None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.613192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:51.670488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c94b81-cefd-4a61-a23e-02f9bf61fb9f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.694767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32925-abc9-42b4-8053-79f8a088a4cb None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.705927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.706744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.707075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.707358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.718381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:51.725917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:51.727089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:51.728129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:51.732693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 390/781] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:51.733491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.736195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081d7dd-338f-48de-b091-bff017c0d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.737211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d7dd-338f-48de-b091-bff017c0d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.738500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d7dd-338f-48de-b091-bff017c0d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.738932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d7dd-338f-48de-b091-bff017c0d6c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.739881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081d7dd-338f-48de-b091-bff017c0d6c2 None admin] RBAC: Adding query filter params (interface=public, service_id=a6f9a9b81ea94f6d9e77c6b883e13fa8, region_id=RegionOne) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:51.740346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081d7dd-338f-48de-b091-bff017c0d6c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.741883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081d7dd-338f-48de-b091-bff017c0d6c2 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.748426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:51.753173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 392/782] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/endpoints?service_id=a6f9a9b81ea94f6d9e77c6b883e13fa8&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:51.753173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30f57-a252-4b9f-81f5-632e0dbbf01b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.753173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30f57-a252-4b9f-81f5-632e0dbbf01b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.753173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30f57-a252-4b9f-81f5-632e0dbbf01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.772326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-3de30f57-a252-4b9f-81f5-632e0dbbf01b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:51.773922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3de30f57-a252-4b9f-81f5-632e0dbbf01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:51.843854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6557-0a64-4b35-bb96-2aae7ce67d90 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:51.858244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 393/783] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:51.858244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de30f57-a252-4b9f-81f5-632e0dbbf01b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:51.878104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:51.888521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:51.890200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:51.890200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:51.890200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:51.890569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:51.892009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:51.901926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 391/784] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:51.907087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.001932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de30f57-a252-4b9f-81f5-632e0dbbf01b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.003697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:52.030779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6570488-3b7a-44f4-8501-6c00e85a0028 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.049838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.050948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.051464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.051945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.052928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:52.053442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.055101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.070727 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 394/785] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:52.072022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.078402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.079095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.079386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.079668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.080366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.081787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.092773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 392/786] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:25:51 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:52.093552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.205371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:52.230193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4e088-aa9b-4297-b542-0a8f5b206d25 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.234754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c444c7-1aaf-4774-8e79-ddb385c0dc22 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.272637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d8bec-3949-4bb4-bf37-c5e977f24679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.273365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8bec-3949-4bb4-bf37-c5e977f24679 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.273651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8bec-3949-4bb4-bf37-c5e977f24679 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.273925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8bec-3949-4bb4-bf37-c5e977f24679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.287372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18cc22-7dfe-4b22-9368-3dde718e8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.289870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18cc22-7dfe-4b22-9368-3dde718e8f01 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.291304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18cc22-7dfe-4b22-9368-3dde718e8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.294667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18cc22-7dfe-4b22-9368-3dde718e8f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.296617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d8bec-3949-4bb4-bf37-c5e977f24679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-b73d8bec-3949-4bb4-bf37-c5e977f24679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:52.307445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:52.308433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:52.309340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:52.309969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:52.311683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18cc22-7dfe-4b22-9368-3dde718e8f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.312594 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 395/787] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:52.313163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18cc22-7dfe-4b22-9368-3dde718e8f01 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.314777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0fb8-f7ac-48da-8917-361e03aa3baf None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.315305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0fb8-f7ac-48da-8917-361e03aa3baf None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.315817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0fb8-f7ac-48da-8917-361e03aa3baf None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.317576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 396/788] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:52.318546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d0fb8-f7ac-48da-8917-361e03aa3baf None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2a18cc22-7dfe-4b22-9368-3dde718e8f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:52.336822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:52.337794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:52.338721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:52.338721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:52.338721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:52.338721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:52.338721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 393/789] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:52.339816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f37d-2a29-4249-9acb-cc851c5a345d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.340161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f37d-2a29-4249-9acb-cc851c5a345d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.341106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f37d-2a29-4249-9acb-cc851c5a345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.359890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cf91f37d-2a29-4249-9acb-cc851c5a345d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:52.361196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cf91f37d-2a29-4249-9acb-cc851c5a345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:52.432886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 394/790] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:52.438750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f37d-2a29-4249-9acb-cc851c5a345d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.443181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d0fb8-f7ac-48da-8917-361e03aa3baf None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.484959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.486612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.487090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.487786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.488685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:52.489147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.491857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.503222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 397/791] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:52.504859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.517249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:52.562299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f37d-2a29-4249-9acb-cc851c5a345d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.586409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:52.603392 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.604514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.604836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.605063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.607285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:52.607285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.608796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.622157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 395/792] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:52.623138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.642447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af67245-57e5-4e5a-9b2e-a5a194ac10f8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.696181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.697662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.698162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.698825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.713402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:52.733112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:52.734147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:52.735056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:52.736326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c623-fac0-4af7-b045-a49370ac1855 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.739970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 398/793] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:52.739970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.780416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.781264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.781546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.781823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.794317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.795917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.804265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:52.822166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:52.823276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:52.824190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:52.824190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:52.824190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:52.824190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:52.824190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 396/794] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:52.824190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.849810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368790fc-a04d-4922-90f4-ff3856a67ced None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.859559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:52.885211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.886069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.886321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.886600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.894502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.896234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:52.910490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:52.911654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:52.912712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 399/795] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:52.913334 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:52.936715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4e9f4-b241-4034-8b73-a0d44e301eec None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:52.975121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:52.976030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:52.976483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:52.976996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:52.977985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:52.978457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:52.980013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:52.994437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 397/796] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:52.995750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.017593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0eb12-5dc7-488c-a1c6-b36303e55c5b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.040526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.052448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.053113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.053399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.053685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.054435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:53.054747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.065620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.073386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 400/797] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:53.074246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.104116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.111750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac654a69-5dcb-44e4-bf9c-868908f15ef2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.148025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.149238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.149676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.150093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.151090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:53.151543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.153665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.173025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 398/798] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 19 21:25:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:53.174144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.180481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93f91b-9f3b-414f-b23a-cdaaa83c9360 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.219255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.220062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.220707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.221001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.241244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.243736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:53.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:53.267601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:53.268474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:53.268474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:53.268474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:53.268474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:53.275630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 401/799] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:53.275630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.307772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add0330-15b7-4047-ae70-68cc7a51757a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.328478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.346046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290236a-591f-44af-a587-30fa2040772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.347023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290236a-591f-44af-a587-30fa2040772c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.357400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290236a-591f-44af-a587-30fa2040772c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.357400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290236a-591f-44af-a587-30fa2040772c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.357400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290236a-591f-44af-a587-30fa2040772c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.357664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290236a-591f-44af-a587-30fa2040772c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a290236a-591f-44af-a587-30fa2040772c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:53.373589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:53.374646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:53.375566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 399/800] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:53.376638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290236a-591f-44af-a587-30fa2040772c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.395734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.421489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f661cd-c20d-43bf-a67d-12bfa2c22998 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.463443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.464562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.465032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.466015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.476911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.478752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:53.497975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:53.499073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:53.499967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:53.499967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:53.499967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:53.499967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:53.502103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290236a-591f-44af-a587-30fa2040772c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.502345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 402/801] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:53.503331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.555166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.556142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.556438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.556724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.557445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:53.557758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.559977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.582340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 400/802] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:53.582340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.604550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.619947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc379ae-18f3-424d-b3db-85fbfe2f92a1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.657867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.659398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.659881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.660381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.661426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:53.661934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.663643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.671854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.682466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 403/803] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:53.683984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.700162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e9e63-0944-469c-98ad-593def6cb671 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.737525 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.738193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.738507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.738785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.739504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:53.739814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.741184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.753805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 401/804] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:53.754607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.795124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54c87-27d6-4f7d-91d9-c8f896b633b6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.833551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.834739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.835278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.835748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.844050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.845759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:53.861757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:53.862767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:25:53.863682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:53.864199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0de0-c532-43bc-a257-2c34546fcb3d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:53.866058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 404/805] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:53.871352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.876085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.900511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:53.901312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:53.901630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:53.901930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:53.904449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:53.913903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:53.915633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:53.935191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:53.936127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:53.937255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:53.937255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:53.937255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:53.937255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:53.939639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 402/806] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:53.940629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:53.985976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26c9a-6698-4cb8-9553-55dc224157b5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.023265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.024055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.024495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.024686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.032749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.034681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.047553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62e97-5baa-468d-bd7b-61076da5b20e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:54.051617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:54.052606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:54.053486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 405/807] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:54.054812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.088159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.089123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.089586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.090044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.091132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:54.091627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.093253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.111491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 403/808] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:54.112577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.131898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:54.162119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:54.179230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ae00-2404-419e-9f76-59c021917def None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.222062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.223069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.223495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.223933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.224797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:54.225248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.225834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ce348-aace-4923-b452-2ac492b6e5f7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.226936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.241514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 406/809] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:54.242792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.263498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.264296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.264882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.265073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.265956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:54.266408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.267934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.280927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 404/810] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:54.282021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.372688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169125f5-4df8-4a73-bf0f-7ea505897654 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.391199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f132-1849-41ff-8353-6a8650c7f4d3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.394359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:54.398521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:54.410027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd57e2-ec01-45af-b4ea-5c7f799f4cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.410712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd57e2-ec01-45af-b4ea-5c7f799f4cdf None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.411001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd57e2-ec01-45af-b4ea-5c7f799f4cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.411279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd57e2-ec01-45af-b4ea-5c7f799f4cdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.428127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.429806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.430488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.431252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.440562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.442025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:54.457068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:54.457943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 405/811] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:54.459176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.483736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd57e2-ec01-45af-b4ea-5c7f799f4cdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.485198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd57e2-ec01-45af-b4ea-5c7f799f4cdf None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.566862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e7a36-044d-450a-9964-e4fab961dc15 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.590863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 407/812] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:25:54.590863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0a93-747f-48ec-afdc-15583530d3a8 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.590863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0a93-747f-48ec-afdc-15583530d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.590863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0a93-747f-48ec-afdc-15583530d3a8 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.590863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 408/813] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:54.590863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0a93-747f-48ec-afdc-15583530d3a8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.605370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07496666-70aa-4060-a4a6-74015278d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.606310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496666-70aa-4060-a4a6-74015278d80c None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.606594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496666-70aa-4060-a4a6-74015278d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.606865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496666-70aa-4060-a4a6-74015278d80c None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/4af877878304440b9aa24964dedfadf1/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.608802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496666-70aa-4060-a4a6-74015278d80c None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=4af877878304440b9aa24964dedfadf1, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.610254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496666-70aa-4060-a4a6-74015278d80c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.615531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:54.688801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0a93-747f-48ec-afdc-15583530d3a8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.694802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 406/814] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:54 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/4af877878304440b9aa24964dedfadf1/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:54.696103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca5c1-40a4-4b66-ac5a-4da6cb9e6aad None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.696394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca5c1-40a4-4b66-ac5a-4da6cb9e6aad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.696672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca5c1-40a4-4b66-ac5a-4da6cb9e6aad None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.697963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 407/815] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:54.702078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca5c1-40a4-4b66-ac5a-4da6cb9e6aad None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.737900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21c912-abe6-4451-b7e7-f87041bcd55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.738569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:54.740221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21c912-abe6-4451-b7e7-f87041bcd55a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.740711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21c912-abe6-4451-b7e7-f87041bcd55a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.741225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21c912-abe6-4451-b7e7-f87041bcd55a None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.742823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21c912-abe6-4451-b7e7-f87041bcd55a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:54.743400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21c912-abe6-4451-b7e7-f87041bcd55a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.746267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21c912-abe6-4451-b7e7-f87041bcd55a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.769459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 409/816] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:54.769459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675aa77-2d7d-4bec-85b9-885e1c5c53ed None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.769459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675aa77-2d7d-4bec-85b9-885e1c5c53ed None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.769459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675aa77-2d7d-4bec-85b9-885e1c5c53ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.786381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6675aa77-2d7d-4bec-85b9-885e1c5c53ed None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:54.787600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6675aa77-2d7d-4bec-85b9-885e1c5c53ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:54.839641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca5c1-40a4-4b66-ac5a-4da6cb9e6aad None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:54.870180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 410/817] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:54.872175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55b16-0797-466b-ba56-e69f4d35daf1 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.872462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55b16-0797-466b-ba56-e69f4d35daf1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.872738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55b16-0797-466b-ba56-e69f4d35daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.900892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-39a55b16-0797-466b-ba56-e69f4d35daf1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:54.902180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-39a55b16-0797-466b-ba56-e69f4d35daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:54.906644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:54.907453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:54.907735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:54.908066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:54.913235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:54.918961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:54.920424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:54.939162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:54.940266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:54.941299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:54.941299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:54.941299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:54.941299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:54.941299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 408/818] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:54.941781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:54.978275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 411/819] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:54.978275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a55b16-0797-466b-ba56-e69f4d35daf1 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.028240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:55.050893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9197b-25c0-4f91-9ea3-7fe36e7d6f72 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.085374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a55b16-0797-466b-ba56-e69f4d35daf1 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.087124 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.088085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.088429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.088709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/13b68cce32bf48c283ea53cb65f4e1b6/roles/24d080895b854a35950230f3ec003570` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.103722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=13b68cce32bf48c283ea53cb65f4e1b6, role_id=24d080895b854a35950230f3ec003570)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.105130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.121007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.121930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.122239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.122524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] PATH_INFO: `/v3/services/network` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.123175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.124546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:55.136100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:55.137774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:25:55.138836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:55.139863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 412/820] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:54 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:55.140648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.151249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:55.183495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 409/821] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:25:54 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/13b68cce32bf48c283ea53cb65f4e1b6/roles/24d080895b854a35950230f3ec003570 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:25:55.184701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.283231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9f60-f63a-4ce4-9471-34279bdf87da None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.320567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87e55d-69f4-4003-8c17-840ae9b1a0bd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.355598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:55.359191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.360080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.360541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.360970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.361861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:55.362363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.366657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.366813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.367647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.372593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.372593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.372593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.372593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:55.386750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:55.388367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:55.394231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 410/822] 10.222.0.59 () {56 vars in 1129 bytes} [Thu May 19 21:25:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:55.395085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.401245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 413/823] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:55.403973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.495628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:55.538291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222a380-2221-4144-9dd2-437f07989234 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.561929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773cae-147e-4ea1-bb1a-3006227a5bac None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.604898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.606352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.606879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.606879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.607592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] RBAC: Adding query filter params (name=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:55.607897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.609378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.614807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 411/824] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:25:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:55.615619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.631239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.633079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.633545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.633989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.635066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:55.635908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.640078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.655160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 414/825] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 19 21:25:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:55.656326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.709439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:55.776100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4408c61-c7b2-48c8-a284-a53b6f534614 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.831508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e07d4-6fb7-443d-a5f0-1fab93f8dc39 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:55.832672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.834420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.836603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.837783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.859820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.861809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.863217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:55.871136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:55.876774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:55.876774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:55.876774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:55.876774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:55.876774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:55.876774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:55.881986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 415/826] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:25:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:55.883016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:55.911288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:55.912238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:55.913172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:55.922885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 412/827] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:55.923766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:56.003320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50aa42-af89-4c77-9f75-ceb4f9b54ff3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:56.040095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:56.041031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:56.041472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:56.041852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:56.042693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:56.043126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:56.044567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9c2e-9465-4480-b407-595840fc204d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:56.045321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:56.051173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 416/828] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 19 21:25:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:56.052217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:56.060292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:56.082142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:56.082890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:56.083246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:56.083588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:56.084391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:56.085825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:56.116562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:56.158921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad1664-3850-43af-af01-0cad2c67dbc9 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:56.192120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:56.193188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:56.193628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:56.194083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:56.195040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:56.195504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:56.197086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:56.207476 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 413/829] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:25:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:56.208618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:56.217093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 417/830] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:56.228919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:56.435427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8669be-943b-4909-90c6-73c12d9ee888 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:56.436560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c165db-eb72-47b9-9261-2a737198cde5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:56.458678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:56.475413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8171b6-deec-4427-87fe-f611ac7357ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:56.476900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8171b6-deec-4427-87fe-f611ac7357ab None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:56.477199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8171b6-deec-4427-87fe-f611ac7357ab None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:56.477481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8171b6-deec-4427-87fe-f611ac7357ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:56.478380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8171b6-deec-4427-87fe-f611ac7357ab None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=37df82be35a448bf819e4f157741b8f1) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:56.478704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8171b6-deec-4427-87fe-f611ac7357ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:56.480361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8171b6-deec-4427-87fe-f611ac7357ab None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:56.481519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41facc9f-3c97-4fde-9dab-8867deab4780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:56.482506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41facc9f-3c97-4fde-9dab-8867deab4780 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:56.483214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41facc9f-3c97-4fde-9dab-8867deab4780 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:56.483665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41facc9f-3c97-4fde-9dab-8867deab4780 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:56.485208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41facc9f-3c97-4fde-9dab-8867deab4780 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:56.487182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41facc9f-3c97-4fde-9dab-8867deab4780 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:56.489212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 418/831] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:56 2022] GET /identity/v3/role_assignments?user.id=37df82be35a448bf819e4f157741b8f1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:56.605077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 414/832] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:25:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:25:57.063868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949e59-da77-47db-a226-40b0b8448651 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.064394 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949e59-da77-47db-a226-40b0b8448651 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.064718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949e59-da77-47db-a226-40b0b8448651 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.066476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 419/833] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:57.071842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aec5d0-0780-4fd2-ba3e-9ccef1f47561 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.072246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aec5d0-0780-4fd2-ba3e-9ccef1f47561 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.072429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aec5d0-0780-4fd2-ba3e-9ccef1f47561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.090752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-53aec5d0-0780-4fd2-ba3e-9ccef1f47561 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:57.091939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-53aec5d0-0780-4fd2-ba3e-9ccef1f47561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:57.110442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:57.174990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 415/834] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:57.206086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42949e59-da77-47db-a226-40b0b8448651 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:57.329422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42949e59-da77-47db-a226-40b0b8448651 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:57.364928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:57.365769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.366064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.366373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.376863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:57.384795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:57.385712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:57.386591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 420/835] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:57.392848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aec5d0-0780-4fd2-ba3e-9ccef1f47561 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:57.502052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aec5d0-0780-4fd2-ba3e-9ccef1f47561 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:57.542044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3824e5-2cf7-46d7-b712-30949438d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:57.543044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3824e5-2cf7-46d7-b712-30949438d37c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.543527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3824e5-2cf7-46d7-b712-30949438d37c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.543936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3824e5-2cf7-46d7-b712-30949438d37c None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.545072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3824e5-2cf7-46d7-b712-30949438d37c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:57.545532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3824e5-2cf7-46d7-b712-30949438d37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:57.547687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3824e5-2cf7-46d7-b712-30949438d37c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:57.558990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 416/836] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:57.565936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:57.626620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:57.656254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd8e1-d15d-4aa1-bf83-b55e1589990f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.656544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd8e1-d15d-4aa1-bf83-b55e1589990f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.656825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd8e1-d15d-4aa1-bf83-b55e1589990f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.658458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 417/837] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:57.663650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293783cd-f7ce-42b7-b7e3-ab5d74ac100f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.663936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293783cd-f7ce-42b7-b7e3-ab5d74ac100f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.664216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293783cd-f7ce-42b7-b7e3-ab5d74ac100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.678517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a22c5-670b-4c4c-a187-ac4f0398ae08 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:57.687765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-293783cd-f7ce-42b7-b7e3-ab5d74ac100f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:57.689658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-293783cd-f7ce-42b7-b7e3-ab5d74ac100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:57.694016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:57.716954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:57.718171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.718547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.718890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.730413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:57.732506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:57.750772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:57.751734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:57.752617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:57.752617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:57.752617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:57.752617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:57.752617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 421/838] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:57.758283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:57.789082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 418/839] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:57.813503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293783cd-f7ce-42b7-b7e3-ab5d74ac100f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:57.866986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:57.873803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf65ba-1638-4fa7-85cf-c8429dcba0d2 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:57.910244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:57.911097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.911453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.911829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.912918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:57.913666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:57.915795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:57.925436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293783cd-f7ce-42b7-b7e3-ab5d74ac100f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:57.929161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 422/840] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:57.934855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:57.963935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:57.965230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:57.965711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:57.966325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:57.974736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:57.978076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:25:57.986867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:57.994038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:57.994906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 419/841] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:25:57.995649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.041098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147442a4-d918-44de-925f-7822b37cb56b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.077787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.078884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.079170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.079449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.086939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.088439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:58.104093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:58.105012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:25:58.105986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:58.110173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 423/842] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:58.110678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42560ae-36d9-4b85-b396-25f6354b0165 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.111118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.128901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:58.147714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.148645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.149126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.149617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.150689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:58.151201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.153352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.166552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 420/843] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:25:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:58.168268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.216990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8454e-e7c3-4df3-a0c9-b2ce3f1d4677 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.235388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:58.253100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.253999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.254470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.254920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.256009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:58.256503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.258164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.282684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ffbc-d0e3-4dd8-a08a-090a193608a5 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.295530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 424/844] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:58.300631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.330360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.331307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.331646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.332304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.346536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.347990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:58.372489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:58.373405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:58.374324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:58.374324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:58.374324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:58.374324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:58.374324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 421/845] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:58.383630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.392523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:58.420103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd9a65-596e-4700-86c6-742a80d1041a None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.455853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.456508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.456798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.457073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.521210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c92ef-8f62-48f8-987f-34721a42bc37 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.533309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.534828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.540795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:58.569091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae51807-b368-4342-9986-1b14effd750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.570925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51807-b368-4342-9986-1b14effd750a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.570925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51807-b368-4342-9986-1b14effd750a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.571128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51807-b368-4342-9986-1b14effd750a None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.571739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae51807-b368-4342-9986-1b14effd750a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:58.572053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae51807-b368-4342-9986-1b14effd750a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.573432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae51807-b368-4342-9986-1b14effd750a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.592455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 422/846] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:25:58.594313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae51807-b368-4342-9986-1b14effd750a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.635340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:58.665831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 425/847] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:25:58.673445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.703526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae51807-b368-4342-9986-1b14effd750a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.743259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.744198 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.744553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.744904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.753345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.754924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:25:58.771556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:58.772542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:58.773456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 423/848] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:58.779680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.818011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e768d-f8e9-4df0-850c-4aac20e8ccd6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.838814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:58.875607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587482a-f5b1-489c-b451-4731ce54669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.876756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587482a-f5b1-489c-b451-4731ce54669f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.877157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587482a-f5b1-489c-b451-4731ce54669f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.877713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587482a-f5b1-489c-b451-4731ce54669f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.892849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587482a-f5b1-489c-b451-4731ce54669f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.895072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587482a-f5b1-489c-b451-4731ce54669f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.916059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848a20-cbbe-45dd-a0fb-7ef16e632df1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-5587482a-f5b1-489c-b451-4731ce54669f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:58.921097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:58.922088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 426/849] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a236ed-2c47-42c6-9ee5-ab758bb4d169 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a236ed-2c47-42c6-9ee5-ab758bb4d169 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.928232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a236ed-2c47-42c6-9ee5-ab758bb4d169 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.930533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 427/850] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:58.931532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a236ed-2c47-42c6-9ee5-ab758bb4d169 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:58.960801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:58.961250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658da88-aae4-4511-b2b3-8c03b864c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:58.962282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658da88-aae4-4511-b2b3-8c03b864c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.962813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658da88-aae4-4511-b2b3-8c03b864c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.963090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658da88-aae4-4511-b2b3-8c03b864c4c6 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:58.964072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658da88-aae4-4511-b2b3-8c03b864c4c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:58.964690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658da88-aae4-4511-b2b3-8c03b864c4c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:58.966564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658da88-aae4-4511-b2b3-8c03b864c4c6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:58.990939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 424/851] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:58.992931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0200-076d-4ea2-8622-b852964af2ee None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:58.993372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0200-076d-4ea2-8622-b852964af2ee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:58.993729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0200-076d-4ea2-8622-b852964af2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.010413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-88df0200-076d-4ea2-8622-b852964af2ee None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:59.011598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-88df0200-076d-4ea2-8622-b852964af2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:59.038191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a236ed-2c47-42c6-9ee5-ab758bb4d169 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.071885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c9f45-1dc5-4e73-b49d-79c87ea3af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.072542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9f45-1dc5-4e73-b49d-79c87ea3af44 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.072834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9f45-1dc5-4e73-b49d-79c87ea3af44 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.073122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9f45-1dc5-4e73-b49d-79c87ea3af44 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.073842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c9f45-1dc5-4e73-b49d-79c87ea3af44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:59.074150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c9f45-1dc5-4e73-b49d-79c87ea3af44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.076072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c9f45-1dc5-4e73-b49d-79c87ea3af44 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.076958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 425/852] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:59.077856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0200-076d-4ea2-8622-b852964af2ee None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.094759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 428/853] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:59.096971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efdd2-91f7-4def-b069-9fc43ccb164a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.097709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efdd2-91f7-4def-b069-9fc43ccb164a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.098177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efdd2-91f7-4def-b069-9fc43ccb164a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.099744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 429/854] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:25:59.100596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253efdd2-91f7-4def-b069-9fc43ccb164a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.109884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.183230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0200-076d-4ea2-8622-b852964af2ee None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.185410 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.201189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253efdd2-91f7-4def-b069-9fc43ccb164a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.218726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ed30-ff44-48d6-ab2a-674015d8326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.219414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ed30-ff44-48d6-ab2a-674015d8326b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.219699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ed30-ff44-48d6-ab2a-674015d8326b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.219980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ed30-ff44-48d6-ab2a-674015d8326b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.233761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.234561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.234841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.235116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.241550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.243000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:25:59.256783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:59.257868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 430/855] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:59.259075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.292602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ed30-ff44-48d6-ab2a-674015d8326b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.294101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ed30-ff44-48d6-ab2a-674015d8326b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.318044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.362552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7d46-b09f-40b8-80aa-fe1ae03a6ac4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.390922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 426/856] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:25:59.392204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5a779-6ee8-40e5-bbc1-d191ddf99387 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.392499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5a779-6ee8-40e5-bbc1-d191ddf99387 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.392782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5a779-6ee8-40e5-bbc1-d191ddf99387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.395527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.396489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.396766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.397040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.397690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.399078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:59.411428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:59.417389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:25:59.419027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:25:59.420006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-51a5a779-6ee8-40e5-bbc1-d191ddf99387 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:25:59.420102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 431/857] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:59.420190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-51a5a779-6ee8-40e5-bbc1-d191ddf99387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:25:59.420271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.429644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.480379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 427/858] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:25:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:25:59.481723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5a779-6ee8-40e5-bbc1-d191ddf99387 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.518551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fd1b5-fd10-4585-8a6c-1f4abd4429ec None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.533818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.551340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.552005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.552269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.552539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.553309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:59.553607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.555049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.567662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 432/859] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:59.568445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.585606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5a779-6ee8-40e5-bbc1-d191ddf99387 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.620233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.621011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.621834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.622111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.631996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.633426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.635609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:25:59.650870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:59.661263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:59.662162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:25:59.662162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:25:59.662162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:25:59.662162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:59.662162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 428/860] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:59.662162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.664586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aaa2d-bee8-47d7-8b5b-5931a1c743af None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.699311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.699975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.700265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.700543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.701239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:59.701545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.702940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.707385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 433/861] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:59.708158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.753864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ab6d-5964-4148-ae87-62511680c4ea None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.756095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.787507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.788318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.788605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.788887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.789534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.790932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:25:59.803299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:25:59.804388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:25:59.805390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 429/862] 10.222.0.59 () {56 vars in 1132 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:25:59.806399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.808506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3a257-fb0f-4586-82b7-4299ab5f897b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.842448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.843100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.843381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.843660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.844479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=4af877878304440b9aa24964dedfadf1) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:59.844789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.846239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.848029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:59.866242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 434/863] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/role_assignments?user.id=4af877878304440b9aa24964dedfadf1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:59.866242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.915995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af09ea-0a28-470c-9a3e-db20fd41dc22 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:25:59.953996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:25:59.954710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:25:59.954997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:25:59.955276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:25:59.956019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:25:59.956333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:25:59.957755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:25:59.971557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 430/864] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:25:59.972435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:25:59.973610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978a77-5b91-4bfc-be89-0d2a7d593435 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:00.007840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:00.018906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:00.019912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:00.020351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:00.020773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:00.022191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:00.022191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:00.023464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:00.029375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 435/865] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:00.030222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:00.111119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5aaf-bfd7-47ab-a35b-fec6471b6f73 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:00.114817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:00.153795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:00.154681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:00.155073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:00.155477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:00.156308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:00.156716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:00.158257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:00.163978 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 431/866] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:25:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:00.169868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6069-c10c-4bef-bc27-1c77532d48ac None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:00.171327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:00.215604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:00.216710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:00.217160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:00.217606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:00.226155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:00.227643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:00.244807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:00.245745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:00.247251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 436/867] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:00.252685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:00.309631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76da1-0947-4f54-b0a1-16a04a54c4a1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:00.346602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:00.360350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:00.361354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:00.361699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:00.361985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:00.362798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:00.363110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:00.365040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:00.374299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 432/868] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:00.383546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba06c79-5bed-488b-ba1a-32328f8c40a7 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:00.412153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:00.424433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3296b95-7e88-4e9c-8833-8a181ddfa905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:00.427913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3296b95-7e88-4e9c-8833-8a181ddfa905 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:00.427913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3296b95-7e88-4e9c-8833-8a181ddfa905 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:00.427913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3296b95-7e88-4e9c-8833-8a181ddfa905 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:00.427913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3296b95-7e88-4e9c-8833-8a181ddfa905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:00.427913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3296b95-7e88-4e9c-8833-8a181ddfa905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:00.428695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3296b95-7e88-4e9c-8833-8a181ddfa905 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:00.442107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 437/869] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:00.448227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:00.561871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e3285-7132-4ad1-a0f2-6333259fc0a4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:00.599613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a05b82-f265-43c3-ad8d-6724e80a0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:00.600633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a05b82-f265-43c3-ad8d-6724e80a0d91 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:00.600921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a05b82-f265-43c3-ad8d-6724e80a0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:00.601199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a05b82-f265-43c3-ad8d-6724e80a0d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:00.602026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a05b82-f265-43c3-ad8d-6724e80a0d91 None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=13b68cce32bf48c283ea53cb65f4e1b6) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:00.602431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a05b82-f265-43c3-ad8d-6724e80a0d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:00.603914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a05b82-f265-43c3-ad8d-6724e80a0d91 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:00.611069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 433/870] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:00 2022] GET /identity/v3/role_assignments?user.id=13b68cce32bf48c283ea53cb65f4e1b6&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:02.382522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184007-d416-4b6e-83da-30b0008c5fa0 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.383059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184007-d416-4b6e-83da-30b0008c5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.383059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184007-d416-4b6e-83da-30b0008c5fa0 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.384726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 438/871] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:02.390666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee397-4227-4766-9e46-bbec610b5120 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.391076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee397-4227-4766-9e46-bbec610b5120 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.391269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee397-4227-4766-9e46-bbec610b5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.392707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e82f-48e6-4e7a-8f12-ebecf930b444 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.393089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e82f-48e6-4e7a-8f12-ebecf930b444 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.393371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e82f-48e6-4e7a-8f12-ebecf930b444 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.395193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 439/872] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:26:02.400515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53ebf5-8450-4cc0-accd-906a59371e20 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.400798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53ebf5-8450-4cc0-accd-906a59371e20 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.401074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53ebf5-8450-4cc0-accd-906a59371e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.408922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cbdee397-4227-4766-9e46-bbec610b5120 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:02.410097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cbdee397-4227-4766-9e46-bbec610b5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:02.419416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4b53ebf5-8450-4cc0-accd-906a59371e20 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:02.420610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4b53ebf5-8450-4cc0-accd-906a59371e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:02.426068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:02.483964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 434/873] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:02.510771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee397-4227-4766-9e46-bbec610b5120 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:02.516736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 440/874] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:02.536544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53ebf5-8450-4cc0-accd-906a59371e20 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:02.637315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee397-4227-4766-9e46-bbec610b5120 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:02.647821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53ebf5-8450-4cc0-accd-906a59371e20 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:02.662999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:02.681656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4c6b2-c882-4307-8733-7b5478982872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:02.682954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4c6b2-c882-4307-8733-7b5478982872 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.683241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4c6b2-c882-4307-8733-7b5478982872 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.683625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4c6b2-c882-4307-8733-7b5478982872 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.684813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4c6b2-c882-4307-8733-7b5478982872 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:02.686244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4c6b2-c882-4307-8733-7b5478982872 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:02.689768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:02.690925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.691372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.691823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.692706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:02.694824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:02.708621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:02.709696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:02.710578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 441/875] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:02.717660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:02.757208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 435/876] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:26:02 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:26:02.762054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebbdfe-05a7-4e42-9d5f-2f35673c1e2e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.762054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebbdfe-05a7-4e42-9d5f-2f35673c1e2e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.762054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebbdfe-05a7-4e42-9d5f-2f35673c1e2e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.762054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 436/877] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:02.767374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220ade-1a3a-4442-ab51-b68e4c834e0b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.767374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220ade-1a3a-4442-ab51-b68e4c834e0b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.774476 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220ade-1a3a-4442-ab51-b68e4c834e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.787864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d7220ade-1a3a-4442-ab51-b68e4c834e0b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:02.790686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d7220ade-1a3a-4442-ab51-b68e4c834e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:02.814471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:02.869436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80ad8-3f44-481f-bac8-14590adb08d9 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:02.907994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 437/878] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:02.919876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:02.919876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:02.919876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:02.919876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:02.920315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:02.920565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:02.921858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:02.927570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 442/879] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:02.933343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220ade-1a3a-4442-ab51-b68e4c834e0b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:02.943406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:02.989890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:03.052361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220ade-1a3a-4442-ab51-b68e4c834e0b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:03.056107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8506577-20df-4925-9f7c-51745e24ffce None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:03.089336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa2609-e6a9-4508-b44b-dc53754ff5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:03.090017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2609-e6a9-4508-b44b-dc53754ff5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.090323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2609-e6a9-4508-b44b-dc53754ff5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.090595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2609-e6a9-4508-b44b-dc53754ff5a6 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.091286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2609-e6a9-4508-b44b-dc53754ff5a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:03.091589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2609-e6a9-4508-b44b-dc53754ff5a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:03.092412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:03.092944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2609-e6a9-4508-b44b-dc53754ff5a6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:03.093043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.093332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.093606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.094333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:03.095337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:03.096177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:03.098713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 438/880] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:03.100300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1ed7-25c4-4b8c-96ac-ea527f24010f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.100596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1ed7-25c4-4b8c-96ac-ea527f24010f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.106431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1ed7-25c4-4b8c-96ac-ea527f24010f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.106431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 439/881] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:03.114335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9c0bc-050e-4002-b88e-242743d6790d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.114335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9c0bc-050e-4002-b88e-242743d6790d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.114335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9c0bc-050e-4002-b88e-242743d6790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.131902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-97f9c0bc-050e-4002-b88e-242743d6790d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:03.133180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-97f9c0bc-050e-4002-b88e-242743d6790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:03.216577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 443/882] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:26:02 2022] POST /identity/v3/services => generated 269 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:03.227868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 440/883] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:03.252108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:03.381933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:03.386559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927ba7-79f7-4653-bd6c-7ab96edd20ee None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:03.425578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:03.426432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.426720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.426997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.439282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:03.447530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:03.448563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:03.449969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 444/884] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 19 21:26:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:03.456355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9c0bc-050e-4002-b88e-242743d6790d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:03.566719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9c0bc-050e-4002-b88e-242743d6790d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:03.595067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:03.604420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:03.605945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.606487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.606988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.607988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:03.608498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:03.610047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:03.619315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 441/885] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 19 21:26:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:03.627319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:03.748622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a11e9-93f7-438f-9b8d-370b9dfc9af1 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:03.785661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:03.786826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.787316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.787777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.799178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:03.800837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:03.819198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:03.820140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:03.821123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:03.821123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:03.821123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:03.821123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:03.823058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 445/886] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:03.828548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:03.935751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582490-fce9-4dc7-babc-601663cb1da4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:03.994073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:03.995076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:03.995590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:03.996561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:03.997445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:03.997921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:03.999534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:04.013610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 442/887] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:04.019670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:04.035882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:04.121757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55479-5d72-499f-b676-402b1e435053 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:04.159947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:04.160757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:04.161039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:04.161315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:04.170004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:04.171479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:26:04.186980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:04.188163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:04.189221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 446/888] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:26:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:04.196065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:04.247753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:04.316704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c59d0e-2800-4847-84fd-b957b75c69a8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:04.352964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:04.353662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:04.353950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:04.354257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:04.355106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:04.355974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:04.357430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:04.376542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 443/889] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 19 21:26:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:04.381856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:04.462029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:04.494036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ae33-75bc-4c26-a455-576fd2be36e6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:04.534326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:04.534909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:04.535194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:04.535474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:04.625318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:04.626731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:04.698437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:04.731695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 447/890] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:04 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:26:04.739320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:04.849633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e86572-033b-45f9-902e-3ed5497d2145 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:04.857493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:04.885500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:04.886328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:04.887182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:04.887511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:04.898036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:04.899526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:04.918426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:04.920360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:04.922077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:04.922077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:04.922077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:04.922077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:04.922077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 444/891] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:04.928241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.040060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78883b9-5ca5-463d-a5fb-4a98832224de None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.077660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d22b7-a217-4903-9290-cef55366fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.078350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d22b7-a217-4903-9290-cef55366fefe None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.078637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d22b7-a217-4903-9290-cef55366fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.078921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d22b7-a217-4903-9290-cef55366fefe None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.079649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d22b7-a217-4903-9290-cef55366fefe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:05.079959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d22b7-a217-4903-9290-cef55366fefe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.081342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d22b7-a217-4903-9290-cef55366fefe None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:05.094162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 448/892] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:05.099745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.163419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237581-6f84-48f4-befb-b2dd6fad5869 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.163728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237581-6f84-48f4-befb-b2dd6fad5869 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.163984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237581-6f84-48f4-befb-b2dd6fad5869 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.165590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 449/893] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:05.171730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff967a3-f411-4191-b725-5a7472ba8dbc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.172006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff967a3-f411-4191-b725-5a7472ba8dbc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.172283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff967a3-f411-4191-b725-5a7472ba8dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.189782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fff967a3-f411-4191-b725-5a7472ba8dbc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:05.190999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fff967a3-f411-4191-b725-5a7472ba8dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:05.211151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fa82-03bf-4097-8b9d-57d843d89d76 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.218029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:05.255321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.256400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.256693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.256976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.266258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.266777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:05.268096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 450/894] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:05.280678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:05.281615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:05.282515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 445/895] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:05.291152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff967a3-f411-4191-b725-5a7472ba8dbc None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.302306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.338618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:05.426078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff967a3-f411-4191-b725-5a7472ba8dbc None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.430396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12cf03-3180-40c6-91a9-0c417b45ec68 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.462432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.463782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.464252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.465311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.466341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:05.466838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.468625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:05.473097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.473896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.474182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.474502 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.475156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.476518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:05.484107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 451/896] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:05.490587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:05.491544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:26:05.492378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:05.494075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.495315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 446/897] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:05.501389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.521054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:05.589613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:05.600564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030ac8-7d99-4e40-ba78-2c36a10ceeec None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.608146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a9003-b218-4007-b630-443c16513f24 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.633059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bdfe0-5dd5-49aa-abd9-c198b53f16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.633714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdfe0-5dd5-49aa-abd9-c198b53f16ef None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.634002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdfe0-5dd5-49aa-abd9-c198b53f16ef None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.634302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdfe0-5dd5-49aa-abd9-c198b53f16ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.635115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bdfe0-5dd5-49aa-abd9-c198b53f16ef None admin] RBAC: Adding query filter params (role.id=73cf35c851a1440e98ee386240aed18e, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=13b68cce32bf48c283ea53cb65f4e1b6) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:05.635421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bdfe0-5dd5-49aa-abd9-c198b53f16ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.637362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bdfe0-5dd5-49aa-abd9-c198b53f16ef None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:05.641717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.642409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.642702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.642818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 452/898] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/role_assignments?user.id=13b68cce32bf48c283ea53cb65f4e1b6&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=73cf35c851a1440e98ee386240aed18e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:05.642976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.643677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:05.643931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a688a-bb74-4c18-87f6-6d458f45ea44 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.644027 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.644219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a688a-bb74-4c18-87f6-6d458f45ea44 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.644499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a688a-bb74-4c18-87f6-6d458f45ea44 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.645332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:05.645885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 453/899] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:05.647362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0da5-19ca-4c91-a393-fcd4f83c2f04 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.647662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0da5-19ca-4c91-a393-fcd4f83c2f04 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.647940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0da5-19ca-4c91-a393-fcd4f83c2f04 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.649349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 454/900] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:05.654025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 447/901] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:05.655378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e127f-615e-45f3-beb7-54df4cd8adb2 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.655674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e127f-615e-45f3-beb7-54df4cd8adb2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.655955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e127f-615e-45f3-beb7-54df4cd8adb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.656466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.673257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e81e127f-615e-45f3-beb7-54df4cd8adb2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:05.674518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e81e127f-615e-45f3-beb7-54df4cd8adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:05.755736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 455/902] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:05.756961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3ed5-597c-486a-a56f-34af03e58ba8 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.757244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3ed5-597c-486a-a56f-34af03e58ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.757515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3ed5-597c-486a-a56f-34af03e58ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.785193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e2c8b-3617-47d4-9308-c0f28af5bb0e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.786907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-14db3ed5-597c-486a-a56f-34af03e58ba8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:05.788110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-14db3ed5-597c-486a-a56f-34af03e58ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:05.799902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:05.829125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.829924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.829924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.830089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.830838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:05.831150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.832535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:05.843730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 448/903] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:05.843730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.857649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:05.865026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 456/904] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:05.873130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3ed5-597c-486a-a56f-34af03e58ba8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:05.960084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0d691-4c65-42af-b362-575282f9f7cf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.975704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3ed5-597c-486a-a56f-34af03e58ba8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:05.993696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:05.994533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:05.994827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:05.995095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:05.995741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:05.997335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:06.009369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:06.010345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:06.011223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 449/905] 10.222.0.59 () {56 vars in 1132 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:06.012086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:06.021220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:06.022108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:06.022567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:06.022990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:06.024078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] RBAC: Adding query filter params (interface=public, service_id=2d8853edce814e82be236b017dbaef92, region_id=RegionOne) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:06.024400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:06.025781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.036111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 457/906] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:26:05 2022] GET /identity/v3/endpoints?service_id=2d8853edce814e82be236b017dbaef92&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:06.036111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:06.048964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:06.095921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:06.120887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66edfdb-939f-4a3f-8bc8-fec5950ee8b3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:06.145339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e302a-3bb1-469e-b04f-e07be2455808 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:06.160143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:06.160881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:06.161233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:06.161580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:06.162411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:06.163782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.181925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:06.182631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:06.182918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:06.183198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:06.183947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:06.184301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:06.185654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.190706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 458/907] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:06.191488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:06.238640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 450/908] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:26:06 2022] POST /identity/v3/services => generated 241 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:06.240304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:06.278736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:06.316513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e980ac-3a01-43a1-a6f1-80a51a0e3aa0 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:06.370029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:06.371442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:06.371644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:06.371888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:06.372580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:06.374010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.381257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 459/909] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:26:06 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:26:06.401339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc27-3678-42a4-897d-5a4d7d4c1e90 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:06.443299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:06.443991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:06.444281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:06.444562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:06.445302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:06.445615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:06.447179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.454853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 451/910] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:06.455395 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:06.460234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:06.577468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bef6-9803-40e6-a724-ec1787e3405b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:06.614121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653437-570b-4433-99e4-4d935dbde4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:06.614841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653437-570b-4433-99e4-4d935dbde4ce None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:06.615119 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653437-570b-4433-99e4-4d935dbde4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:06.615436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653437-570b-4433-99e4-4d935dbde4ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:06.616184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653437-570b-4433-99e4-4d935dbde4ce None admin] RBAC: Adding query filter params (interface=public, service_id=42271e2e015949c6ace027c690d30427, region_id=RegionOne) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:06.616514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653437-570b-4433-99e4-4d935dbde4ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:06.617856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653437-570b-4433-99e4-4d935dbde4ce None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.619448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:06.624579 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 460/911] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:26:06 2022] GET /identity/v3/endpoints?service_id=42271e2e015949c6ace027c690d30427&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:06.630509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:06.735389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355a4c-5b37-4c5f-ac2f-54c532b12ae6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:06.770270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d09bbc-c324-41f0-8bee-3b6b05aec564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:06.770951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d09bbc-c324-41f0-8bee-3b6b05aec564 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:06.771233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d09bbc-c324-41f0-8bee-3b6b05aec564 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:06.771507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d09bbc-c324-41f0-8bee-3b6b05aec564 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:06.772193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d09bbc-c324-41f0-8bee-3b6b05aec564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:06.773608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d09bbc-c324-41f0-8bee-3b6b05aec564 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:06.781424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 452/912] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:26:06 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:26:07.908762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f4f1-f700-4fd0-ba0e-de7bfa7431b1 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:07.909293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f4f1-f700-4fd0-ba0e-de7bfa7431b1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:07.909403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f4f1-f700-4fd0-ba0e-de7bfa7431b1 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:07.911267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 461/913] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:07.917224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5c2ac-dec2-46b2-957e-544429f663c1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:07.917726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5c2ac-dec2-46b2-957e-544429f663c1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:07.917828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5c2ac-dec2-46b2-957e-544429f663c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:07.934574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-42e5c2ac-dec2-46b2-957e-544429f663c1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:07.935744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-42e5c2ac-dec2-46b2-957e-544429f663c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:07.995142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:08.006530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 453/914] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:08.029360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f4f1-f700-4fd0-ba0e-de7bfa7431b1 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:08.138887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f4f1-f700-4fd0-ba0e-de7bfa7431b1 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:08.175358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:08.176092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.176377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.176655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.187546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:08.196038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:08.196961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:08.197784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:08.202235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 462/915] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 19 21:26:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:08.203667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5c2ac-dec2-46b2-957e-544429f663c1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:08.309991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5c2ac-dec2-46b2-957e-544429f663c1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:08.345962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:08.346662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.346947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.347226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.347973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:08.348282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:08.349658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:08.358932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 454/916] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 19 21:26:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:08.364588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:08.431901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:08.476808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafab44-47d8-4e81-9e40-52fcec28023f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:08.513355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ff427-d32b-4e82-984e-847a15135dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:08.514531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ff427-d32b-4e82-984e-847a15135dac None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.515044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ff427-d32b-4e82-984e-847a15135dac None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.515550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ff427-d32b-4e82-984e-847a15135dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.526989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ff427-d32b-4e82-984e-847a15135dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:08.529305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ff427-d32b-4e82-984e-847a15135dac None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-ea5ff427-d32b-4e82-984e-847a15135dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:08.548961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:08.549918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:08.550831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:08.550831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:08.550831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:08.550831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:08.557723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 463/917] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:08.563665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:08.580177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dccb2-6cda-491e-9e3b-68f4380c2714 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.580798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dccb2-6cda-491e-9e3b-68f4380c2714 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.581352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dccb2-6cda-491e-9e3b-68f4380c2714 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.583263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 464/918] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:08.588129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d81f-5137-4e97-9ffa-5c7799aa9bb1 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.588659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d81f-5137-4e97-9ffa-5c7799aa9bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.589158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d81f-5137-4e97-9ffa-5c7799aa9bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.608676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ae39d81f-5137-4e97-9ffa-5c7799aa9bb1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:08.610333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ae39d81f-5137-4e97-9ffa-5c7799aa9bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:08.622772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:08.669312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92ed41-a3d3-4942-9ff1-77f0daef2479 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:08.686157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 465/919] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:08.704421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:08.705087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.705373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.705651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.706390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:08.706697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:08.708067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:08.709335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d81f-5137-4e97-9ffa-5c7799aa9bb1 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:08.721133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 455/920] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:08.726873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:08.759078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:08.820936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d81f-5137-4e97-9ffa-5c7799aa9bb1 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:08.836071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf908d-66b5-40a1-b1e3-adb0c2c95f4d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:08.850905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:08.864404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42081754-1480-4153-815f-7f0e473ca6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:08.865222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42081754-1480-4153-815f-7f0e473ca6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.865500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42081754-1480-4153-815f-7f0e473ca6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.865776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42081754-1480-4153-815f-7f0e473ca6a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.866464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42081754-1480-4153-815f-7f0e473ca6a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:08.867837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42081754-1480-4153-815f-7f0e473ca6a6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:08.872598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c95172-2188-4f46-bc41-afa48f023a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:08.873403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95172-2188-4f46-bc41-afa48f023a92 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.873688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95172-2188-4f46-bc41-afa48f023a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.873966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95172-2188-4f46-bc41-afa48f023a92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.881251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c95172-2188-4f46-bc41-afa48f023a92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:08.882731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c95172-2188-4f46-bc41-afa48f023a92 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-42081754-1480-4153-815f-7f0e473ca6a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:08.884889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:08.885856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:08.887383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:08.888665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 466/921] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:08.890242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74ed8-31b2-45c2-b233-b63422eca13b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.890751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74ed8-31b2-45c2-b233-b63422eca13b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.891264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74ed8-31b2-45c2-b233-b63422eca13b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.894263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 467/922] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:08.894738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b74ed8-31b2-45c2-b233-b63422eca13b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-25c95172-2188-4f46-bc41-afa48f023a92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:26:08.908126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:08.909179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:08.910099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 456/923] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:26:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:08.912480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751721c-6d44-4f3f-b472-d89fd6372e24 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:08.912480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751721c-6d44-4f3f-b472-d89fd6372e24 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:08.912480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751721c-6d44-4f3f-b472-d89fd6372e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:08.931686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2751721c-6d44-4f3f-b472-d89fd6372e24 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:08.932982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2751721c-6d44-4f3f-b472-d89fd6372e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:09.022330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 457/924] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:09.022330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751721c-6d44-4f3f-b472-d89fd6372e24 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.022576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b74ed8-31b2-45c2-b233-b63422eca13b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.032145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.068643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.069726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.070037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.070783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.071574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:09.071890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.073398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.084191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 468/925] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:09.084191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.123838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751721c-6d44-4f3f-b472-d89fd6372e24 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.126147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.158414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.159081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.159365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.159642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.160465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:09.160774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.162195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.179809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 458/926] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:09.180603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.183715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c027cf-4c91-4ab3-87d2-f7f3d7a4f9e5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.218344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b813e0-544f-4f50-9d57-6e640b783a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.219129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b813e0-544f-4f50-9d57-6e640b783a73 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.219411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b813e0-544f-4f50-9d57-6e640b783a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.219685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b813e0-544f-4f50-9d57-6e640b783a73 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.220329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b813e0-544f-4f50-9d57-6e640b783a73 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.221692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b813e0-544f-4f50-9d57-6e640b783a73 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-77b813e0-544f-4f50-9d57-6e640b783a73 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:09.233186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:09.234197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.235087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 469/927] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:09.236151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d06b-bf31-4747-84f3-89875c932a8b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.236151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d06b-bf31-4747-84f3-89875c932a8b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.236151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d06b-bf31-4747-84f3-89875c932a8b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.237281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 470/928] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:09.237970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203d06b-bf31-4747-84f3-89875c932a8b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.269833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.286860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83355dc-0196-4e49-8255-57ca0909b849 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.323393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.324349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.324631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.324910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.325607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:09.325918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.327333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.332291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 459/929] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:09.332859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.343536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203d06b-bf31-4747-84f3-89875c932a8b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.363733 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.377139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03a91-8d1b-4f68-b08e-260893388b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.377929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03a91-8d1b-4f68-b08e-260893388b0f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.378232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03a91-8d1b-4f68-b08e-260893388b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.378512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03a91-8d1b-4f68-b08e-260893388b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.389249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03a91-8d1b-4f68-b08e-260893388b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.390720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03a91-8d1b-4f68-b08e-260893388b0f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-c7b03a91-8d1b-4f68-b08e-260893388b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:09.407630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:09.408724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:09.409667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:09.409667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:09.409667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:09.409667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.409667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 471/930] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:09.410059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d4c9-fb3b-4e53-8198-a18dcd081482 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.410314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d4c9-fb3b-4e53-8198-a18dcd081482 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.410598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d4c9-fb3b-4e53-8198-a18dcd081482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.427015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e566d4c9-fb3b-4e53-8198-a18dcd081482 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:09.428171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e566d4c9-fb3b-4e53-8198-a18dcd081482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:09.437926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979110d-07cd-494a-bc5c-ab5d61d078f6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.472174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.472829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.473112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.473393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.474413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:09.474413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.475772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.480575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 460/931] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:09.481361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.493362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 472/932] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:09.494428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d4c9-fb3b-4e53-8198-a18dcd081482 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.508947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.581593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.590624 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cffd5c-482f-41b1-98df-d1c9084005c3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.593421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d4c9-fb3b-4e53-8198-a18dcd081482 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.624423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.625070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.625357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.625632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.626441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] RBAC: Adding query filter params (interface=public, service_id=0bc6c28ef57e4843a3fd1905b392c948, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:09.626755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.628115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.628208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.628802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.629089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.629368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.630086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:09.630428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.631779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.635544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 461/933] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/endpoints?service_id=0bc6c28ef57e4843a3fd1905b392c948&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:09.636162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.645191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 473/934] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:09.645878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.718549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.739399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d643c23-c2c6-48e3-80ec-0fdc98a8ff53 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.743832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf343af-2c34-4c70-a22a-38c9aba18b35 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.772510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.773168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.773454 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.773740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.774467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:09.774778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.776139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.776582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.777912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.778190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.778498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.779140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.780481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.781402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 462/935] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:09.782177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:09.797247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:09.798192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.799057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 474/936] 10.222.0.59 () {56 vars in 1132 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:09.799910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.805635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.885104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd2c40-4963-4b0d-9387-faccd344fd2a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.894655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e3523-6e9f-42a7-9ce5-29dd797514b5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:09.919143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.919809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.920099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.920374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.921054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.922450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.928168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:09.928307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 463/937] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:26:09.928959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:09.929070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:09.929243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:09.929517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:09.936864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:09.938735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:09.941297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:09.955333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:09.956307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:09.957186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 475/938] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:09.958122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:10.028221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:10.047855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf1f0-5a88-48e1-8df5-a88aa39b8a15 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:10.076149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824936b-4293-4e5c-ac7f-9217e235e66f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:10.087451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:10.088133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:10.088419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:10.088704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:10.090083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:10.091466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:10.114721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:10.115391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:10.115673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:10.115958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:10.116696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:10.117008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:10.118426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:10.124559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 476/939] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:10.125371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:10.178546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 464/940] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:26:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:10.180160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:10.190656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:10.241529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b572b15-289a-4bfe-b95b-0b11b987b162 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:10.311677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:10.313091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:10.313601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:10.314174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:10.315240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:10.315759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:10.317576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:10.336483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 477/941] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:10.343349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:10.354020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c468c-45b9-4c90-9e4f-327e8d62f51e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:10.407856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:10.409223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:10.409517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:10.409801 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:10.410562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:10.410877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:10.412752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:10.419254 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 465/942] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:10.424419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:10.428447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:10.470585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f97de-93ae-4d29-9fbc-e25c0649f876 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:10.493288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:10.517974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d908a-195c-45db-8e81-26380819b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:10.519998 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d908a-195c-45db-8e81-26380819b41d None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:10.520431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d908a-195c-45db-8e81-26380819b41d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:10.520853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d908a-195c-45db-8e81-26380819b41d None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/13b68cce32bf48c283ea53cb65f4e1b6/roles/73cf35c851a1440e98ee386240aed18e` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:10.523318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d908a-195c-45db-8e81-26380819b41d None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=13b68cce32bf48c283ea53cb65f4e1b6, role_id=73cf35c851a1440e98ee386240aed18e)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:10.526307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d908a-195c-45db-8e81-26380819b41d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:10.551297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4b76-b16f-4f70-8c87-e8be7002575a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:10.586923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb2acf-974c-4387-bd35-c095b419456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:10.587577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb2acf-974c-4387-bd35-c095b419456f None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:10.587862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb2acf-974c-4387-bd35-c095b419456f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:10.588139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb2acf-974c-4387-bd35-c095b419456f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:10.588877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb2acf-974c-4387-bd35-c095b419456f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:10.590311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb2acf-974c-4387-bd35-c095b419456f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:10.606055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 478/943] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:26:10 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/13b68cce32bf48c283ea53cb65f4e1b6/roles/73cf35c851a1440e98ee386240aed18e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:26:10.670447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 466/944] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:26:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:26:12.236067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9f960-6967-43ac-af3d-75df7ae432ee None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.236618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9f960-6967-43ac-af3d-75df7ae432ee None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.236618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9f960-6967-43ac-af3d-75df7ae432ee None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.238279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 479/945] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:12.243850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3c56-0544-4269-a8c7-17f26d89f5ef None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.244243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3c56-0544-4269-a8c7-17f26d89f5ef None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.244407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3c56-0544-4269-a8c7-17f26d89f5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.262581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-33dd3c56-0544-4269-a8c7-17f26d89f5ef None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:12.263763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-33dd3c56-0544-4269-a8c7-17f26d89f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:12.342312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:12.363813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 467/946] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:12.389150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9f960-6967-43ac-af3d-75df7ae432ee None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:12.503973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9f960-6967-43ac-af3d-75df7ae432ee None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:12.510520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35435-af01-4c45-9548-1c165128bd41 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.510818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35435-af01-4c45-9548-1c165128bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.511624 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35435-af01-4c45-9548-1c165128bd41 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.513278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 468/947] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:12.518518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cbc71-cf1c-45ff-b57a-8b96170e531a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.518813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cbc71-cf1c-45ff-b57a-8b96170e531a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.519097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cbc71-cf1c-45ff-b57a-8b96170e531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.536109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-789cbc71-cf1c-45ff-b57a-8b96170e531a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:12.537302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-789cbc71-cf1c-45ff-b57a-8b96170e531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:12.544803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:12.546408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.546837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.547254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.548506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:12.550759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:12.568052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:12.569239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:12.570268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:12.574113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 480/948] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:12.579996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:12.626865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:12.634196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 469/949] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:12.662469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cbc71-cf1c-45ff-b57a-8b96170e531a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:12.694155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac13f-e9cd-4d5a-88be-7af3fb09e01e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:12.736981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:12.737997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.738411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.738762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.739703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:12.740083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:12.742180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:12.750308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 481/950] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:12.755342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:12.804969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cbc71-cf1c-45ff-b57a-8b96170e531a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:12.824551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:12.851570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:12.852247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.852530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.852808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.853526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:12.856040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:12.857480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING keystone.server.flask.common [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 21:26:12.893613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21406fce-7d95-481c-863c-cd28eda13268 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:12.901352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:12.916824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.sql.core [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 21:26:12.916824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 21:26:12.916824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [parameters: {'id': '5e5646f076394427a4fd82a172e8d7e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 21:26:12.916824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e5646f076394427a4fd82a172e8d7e9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e5646f076394427a4fd82a172e8d7e9. May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:26:12.935020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 21:26:12.935914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application yield resource May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.rollback() May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.force_reraise() May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise self.value May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application session.commit() May 19 21:26:12.936878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._prepare_impl() May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.flush() May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._flush(objects) May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application compat.raise_( May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application flush_context.execute() May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 21:26:12.938042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rec.execute(self) May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 21:26:12.939076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:26:12.939884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [parameters: {'id': '5e5646f076394427a4fd82a172e8d7e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:12.940774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:12.941731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e5646f076394427a4fd82a172e8d7e9. May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 470/951] 10.222.0.59 () {60 vars in 1140 bytes} [Thu May 19 21:26:12 2022] POST /identity/v3/projects => generated 262 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:12.944799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:12.950039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d417cf-ba3d-438f-abce-86c3155044d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:12.950765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d417cf-ba3d-438f-abce-86c3155044d1 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.951052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d417cf-ba3d-438f-abce-86c3155044d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.951331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d417cf-ba3d-438f-abce-86c3155044d1 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.952044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d417cf-ba3d-438f-abce-86c3155044d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:12.952359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d417cf-ba3d-438f-abce-86c3155044d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:12.953780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d417cf-ba3d-438f-abce-86c3155044d1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:12.959155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 482/952] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:12.960411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6902-2c48-4f86-bd03-a15406c0605b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.960699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6902-2c48-4f86-bd03-a15406c0605b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.960976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6902-2c48-4f86-bd03-a15406c0605b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.962193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 483/953] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:12.963301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf05bd4-9b7b-49a1-8d18-73bb65d30f61 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:12.963620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf05bd4-9b7b-49a1-8d18-73bb65d30f61 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:12.963927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf05bd4-9b7b-49a1-8d18-73bb65d30f61 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:12.969614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 484/954] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:12.970565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf05bd4-9b7b-49a1-8d18-73bb65d30f61 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.066927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3265d7-21b7-4d30-a38f-adc6f1438097 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.087250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf05bd4-9b7b-49a1-8d18-73bb65d30f61 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.100428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abdcd-6587-4858-85c7-a302e94fa22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.101214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abdcd-6587-4858-85c7-a302e94fa22b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.101496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abdcd-6587-4858-85c7-a302e94fa22b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.101777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abdcd-6587-4858-85c7-a302e94fa22b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.108381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abdcd-6587-4858-85c7-a302e94fa22b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.110017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abdcd-6587-4858-85c7-a302e94fa22b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.119643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ec062-8c47-4cac-88d2-5d49422ac207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.120289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec062-8c47-4cac-88d2-5d49422ac207 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.120601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec062-8c47-4cac-88d2-5d49422ac207 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.120878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec062-8c47-4cac-88d2-5d49422ac207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.121601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ec062-8c47-4cac-88d2-5d49422ac207 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.122971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ec062-8c47-4cac-88d2-5d49422ac207 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-657abdcd-6587-4858-85c7-a302e94fa22b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:13.124136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:13.125137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:13.126455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 471/955] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:13.127085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491627f-48e8-428a-b357-cd18c91f461e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.127383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491627f-48e8-428a-b357-cd18c91f461e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.127663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491627f-48e8-428a-b357-cd18c91f461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.144928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6491627f-48e8-428a-b357-cd18c91f461e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:13.147619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6491627f-48e8-428a-b357-cd18c91f461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:13.169777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:13.193941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 485/956] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:26:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:13.195240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a65ca-9259-4173-8e17-e1ea7411c385 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.195527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a65ca-9259-4173-8e17-e1ea7411c385 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.195813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a65ca-9259-4173-8e17-e1ea7411c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.217842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-950a65ca-9259-4173-8e17-e1ea7411c385 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:13.219761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-950a65ca-9259-4173-8e17-e1ea7411c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:13.230676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 472/957] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:13.230676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491627f-48e8-428a-b357-cd18c91f461e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.259144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:13.332828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 486/958] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:13.332828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a65ca-9259-4173-8e17-e1ea7411c385 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.363931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491627f-48e8-428a-b357-cd18c91f461e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.405163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.406100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.406425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.406709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.408143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:13.408143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.409991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.428644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 473/959] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:13.429495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.452151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:13.460258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a65ca-9259-4173-8e17-e1ea7411c385 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.499640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.500982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.501455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.501964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.516374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:13.525532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:13.526573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:13.527988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:13.530729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 487/960] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:13.542313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.554311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1353-86e2-4205-b536-eb6b485c378e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.568121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:13.603321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.604065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.604352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.604630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.605930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.607379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:13.623060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:13.624201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:13.625047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:13.629404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 474/961] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:13.630917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.682598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7756d6-28ae-4065-9c74-a000c3cbd39e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.732505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:13.733147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.733890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.734181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.734564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.735324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:13.735636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.737028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.746322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 488/962] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:13.752097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.752683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b938f-f390-4d4a-9025-a03c54647c58 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.796469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.797229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.797523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.797802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.798685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:13.799004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.800655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.806318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 475/963] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:13.815168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.836533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:13.860367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e28ab-523f-416d-93d7-ca2d2638e4f6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.894996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.895791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.896075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.896358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.908073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.909545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:13.926880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:13.928003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:13.929340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:13.929340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:13.929340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:13.929340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:13.929340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 489/964] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:13.930501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32b9e7-d27c-48cf-b668-73323b215a30 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:13.933791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:13.973592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:13.974542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:13.974979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:13.975410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:13.976406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:13.976865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:13.978514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:13.990539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 476/965] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:14.044459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fbfe-26b8-41bc-88ea-7706856f4fae None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:14.078468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:14.084447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:14.085130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:14.085416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:14.085696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:14.086472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:14.086788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:14.088188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:14.102848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 490/966] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:14.108474 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:14.123999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:14.222953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f8ee2-0a55-4c59-b16e-66b75c8bf1fa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:14.258126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:14.258962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:14.259250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:14.259529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:14.268188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:14.269647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:26:14.285355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:14.286321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:14.287501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 477/967] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:26:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:14.292244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:14.399248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac913c-e676-4647-97db-34381ed59717 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:14.435450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:14.436130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:14.436416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:14.436693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:14.437777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:14.438092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:14.439573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:14.458525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 491/968] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 19 21:26:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:14.464096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:14.534837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:14.570508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8727c46-376c-4c4c-a565-e907cf6b13a5 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:14.607916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:14.608923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:14.609406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:14.609918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:14.684147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:14.685540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:14.752853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:14.788165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 478/969] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:14 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:26:14.794326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:14.848620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:14.896484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109265d2-dff3-461f-86e1-fdb5ce94c8a6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:14.942157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:14.943494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:14.944008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:14.944510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:14.960741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:14.962206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:14.981291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:14.982730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:14.983622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:14.983622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:14.983622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:14.983622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:14.983622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 492/970] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:14.988391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:15.090721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df165-145a-47ae-a0ad-160beb93e886 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:15.125399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:15.126059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.126374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.126651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.127359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:15.127665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:15.129040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:15.141375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 479/971] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:15.146879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:15.248581 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:15.251486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572188-a53b-4ca7-bfdc-a05b94bce338 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:15.286087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:15.286939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.287228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.287506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.295386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:15.296843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:15.311342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:15.312288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:15.313715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 493/972] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:15.318940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:15.379246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:15.427751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378c6b-f9ab-4f4d-8557-637350ded99c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:15.462829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519803fc-9b93-4345-a8f6-5263e14f4f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:15.463487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519803fc-9b93-4345-a8f6-5263e14f4f5f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.463779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519803fc-9b93-4345-a8f6-5263e14f4f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.464060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519803fc-9b93-4345-a8f6-5263e14f4f5f None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.465429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519803fc-9b93-4345-a8f6-5263e14f4f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:15.466022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519803fc-9b93-4345-a8f6-5263e14f4f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:15.467177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519803fc-9b93-4345-a8f6-5263e14f4f5f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:15.480461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 480/973] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:15.486290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:15.516687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b121dc-668a-4ddc-8ef1-338fcf31d1b5 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.516984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b121dc-668a-4ddc-8ef1-338fcf31d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.517169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b121dc-668a-4ddc-8ef1-338fcf31d1b5 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.519427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 481/974] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:26:15.525196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab39ef-0aa3-4b62-ba2a-c576ada63772 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.525482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab39ef-0aa3-4b62-ba2a-c576ada63772 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.525756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab39ef-0aa3-4b62-ba2a-c576ada63772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.543243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-aeab39ef-0aa3-4b62-ba2a-c576ada63772 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:15.544534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-aeab39ef-0aa3-4b62-ba2a-c576ada63772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:15.601338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440f19-5693-4c91-89e1-24efa231b5ab None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:15.622391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 482/975] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:15.639629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab39ef-0aa3-4b62-ba2a-c576ada63772 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:15.646202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:15.647253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.647862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.648345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.649401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] RBAC: Adding query filter params (role.id=73cf35c851a1440e98ee386240aed18e, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=13b68cce32bf48c283ea53cb65f4e1b6) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:15.650033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:15.652359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:15.659258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:15.660619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 494/976] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:15 2022] GET /identity/v3/role_assignments?user.id=13b68cce32bf48c283ea53cb65f4e1b6&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=73cf35c851a1440e98ee386240aed18e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:15.762874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab39ef-0aa3-4b62-ba2a-c576ada63772 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:15.804443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb5b1-285e-4b13-acb2-ad73b023335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:15.805179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb5b1-285e-4b13-acb2-ad73b023335a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.805462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb5b1-285e-4b13-acb2-ad73b023335a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.805747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb5b1-285e-4b13-acb2-ad73b023335a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.806440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb5b1-285e-4b13-acb2-ad73b023335a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:15.808390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb5b1-285e-4b13-acb2-ad73b023335a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-98ebb5b1-285e-4b13-acb2-ad73b023335a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:15.821602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:15.822749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:15.824197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 483/977] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:15.831762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:15.862138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:15.919644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618045f5-21aa-482c-a102-12d814b227d8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.919998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618045f5-21aa-482c-a102-12d814b227d8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.920811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618045f5-21aa-482c-a102-12d814b227d8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.921763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 484/978] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:26:15.926989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf1d0e-c03e-4b97-91ea-a4050736ae3c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.927573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf1d0e-c03e-4b97-91ea-a4050736ae3c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.927702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf1d0e-c03e-4b97-91ea-a4050736ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.945808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd4fd-dea2-4ec7-93d7-b75e0f965450 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:15.948579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bddf1d0e-c03e-4b97-91ea-a4050736ae3c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:15.949774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bddf1d0e-c03e-4b97-91ea-a4050736ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:15.986106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:15.986805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:15.987092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:15.987373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:15.988078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:15.988405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:15.989774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:15.995103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 495/979] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:16.000851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:16.047232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 485/980] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:16.072573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf1d0e-c03e-4b97-91ea-a4050736ae3c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:16.088679 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:16.101877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:16.114761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46949905-5cef-4f3b-b09a-1447cca1f9d7 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:16.152943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:16.154509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.155049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.155550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.156559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:16.157068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:16.158810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:16.165400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 496/981] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:16.174268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:16.180821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf1d0e-c03e-4b97-91ea-a4050736ae3c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:16.222898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:16.223580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.223868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.224150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.224872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:16.226903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:16.268546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.sql.core [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 21:26:16.268546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 21:26:16.268546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [parameters: {'user_id': 'a67a843e32554eab8af8eae3d1ad8276', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 21:26:16.268546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() May 19 21:26:16.279486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:26:16.280373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application yield resource May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.rollback() May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.force_reraise() May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise self.value May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application session.commit() May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 21:26:16.281331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._prepare_impl() May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.flush() May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._flush(objects) May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application compat.raise_( May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application flush_context.execute() May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rec.execute(self) May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 21:26:16.282268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:26:16.283175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:26:16.284025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a67a843e32554eab8af8eae3d1ad8276', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:16.285335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 21:26:16.287756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 486/982] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 19 21:26:16 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:16.289430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:16.302841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290e244-b60f-4ef8-b2f9-06bb05f20aeb None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:16.343007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:16.344032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.344502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.345052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.346259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] RBAC: Adding query filter params (interface=admin, service_id=0bc6c28ef57e4843a3fd1905b392c948, region_id=RegionOne) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:16.346785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:16.348437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:16.354616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 497/983] 10.222.0.59 () {56 vars in 1249 bytes} [Thu May 19 21:26:16 2022] GET /identity/v3/endpoints?service_id=0bc6c28ef57e4843a3fd1905b392c948&interface=admin®ion_id=RegionOne => generated 193 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:16.363234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:16.380168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:16.384549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:16.405509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107c22-c823-4e49-b82f-85d17400a42e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:16.441577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15891db3-e25d-4cfa-afc5-dfb63e342de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:16.442430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891db3-e25d-4cfa-afc5-dfb63e342de4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.442719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891db3-e25d-4cfa-afc5-dfb63e342de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.443050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891db3-e25d-4cfa-afc5-dfb63e342de4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.452248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15891db3-e25d-4cfa-afc5-dfb63e342de4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:16.453886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15891db3-e25d-4cfa-afc5-dfb63e342de4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-15891db3-e25d-4cfa-afc5-dfb63e342de4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:26:16.468498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:16.470015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:26:16.470977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:16.471515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d661d-723e-44e9-93f5-e2f62cdb0f57 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:16.473485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 487/984] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:26:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:16.474871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec815d-ecbe-4b29-9826-1734677458f2 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.475162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec815d-ecbe-4b29-9826-1734677458f2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.475447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec815d-ecbe-4b29-9826-1734677458f2 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.482472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 488/985] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:16.483191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec815d-ecbe-4b29-9826-1734677458f2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:16.513039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec466d79-0311-43b0-b438-a20ddaaf8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:16.513955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec466d79-0311-43b0-b438-a20ddaaf8b37 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.514585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec466d79-0311-43b0-b438-a20ddaaf8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.515040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec466d79-0311-43b0-b438-a20ddaaf8b37 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.515915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec466d79-0311-43b0-b438-a20ddaaf8b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:16.517456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec466d79-0311-43b0-b438-a20ddaaf8b37 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:16.531907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 498/986] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:26:16 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:26:16.531907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9dd39-63ef-4067-b14d-1c52e58529e2 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.531907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9dd39-63ef-4067-b14d-1c52e58529e2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.531907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9dd39-63ef-4067-b14d-1c52e58529e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.550061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-77f9dd39-63ef-4067-b14d-1c52e58529e2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:16.551439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-77f9dd39-63ef-4067-b14d-1c52e58529e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:16.612600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec815d-ecbe-4b29-9826-1734677458f2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:16.651010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 499/987] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:16.660054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea39d72-00be-44f8-9a31-24660a699627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:16.660800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea39d72-00be-44f8-9a31-24660a699627 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.661087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea39d72-00be-44f8-9a31-24660a699627 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.661365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea39d72-00be-44f8-9a31-24660a699627 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.662441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea39d72-00be-44f8-9a31-24660a699627 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:16.662751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea39d72-00be-44f8-9a31-24660a699627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:16.664270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea39d72-00be-44f8-9a31-24660a699627 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:16.666497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:16.678288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9dd39-63ef-4067-b14d-1c52e58529e2 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:16.698640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:16.708855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 489/988] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 19 21:26:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:16.797245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9dd39-63ef-4067-b14d-1c52e58529e2 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:16.837994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18a5a-d9ee-4bc2-a6f7-b32b861011b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:16.838711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18a5a-d9ee-4bc2-a6f7-b32b861011b7 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:16.838995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18a5a-d9ee-4bc2-a6f7-b32b861011b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:16.839837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18a5a-d9ee-4bc2-a6f7-b32b861011b7 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:16.840574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18a5a-d9ee-4bc2-a6f7-b32b861011b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:16.842000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18a5a-d9ee-4bc2-a6f7-b32b861011b7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:16.909955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 500/989] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:26:16 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:18.061287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469cd95-b97d-4966-9a21-3bdc7dc11fed None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:18.061805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469cd95-b97d-4966-9a21-3bdc7dc11fed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:18.061913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469cd95-b97d-4966-9a21-3bdc7dc11fed None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:18.063653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 490/990] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:18.068609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20714-b354-4719-8bfe-894784368ad9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:18.068984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20714-b354-4719-8bfe-894784368ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:18.069160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20714-b354-4719-8bfe-894784368ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:18.086087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fce20714-b354-4719-8bfe-894784368ad9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:18.087281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fce20714-b354-4719-8bfe-894784368ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:18.147909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:18.158938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 501/991] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:18.180376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469cd95-b97d-4966-9a21-3bdc7dc11fed None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:18.285189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469cd95-b97d-4966-9a21-3bdc7dc11fed None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:18.324798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:18.325516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:18.325801 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:18.326075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] PATH_INFO: `/v3/services/image` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:18.326758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:18.328123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:18.339820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:18.340779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:18.346945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 491/992] 10.222.0.59 () {56 vars in 1105 bytes} [Thu May 19 21:26:18 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:18.347748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20714-b354-4719-8bfe-894784368ad9 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:18.459151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20714-b354-4719-8bfe-894784368ad9 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:18.494849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d397a1d-1cf5-4f5b-a384-a85a2c5118db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:18.495521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397a1d-1cf5-4f5b-a384-a85a2c5118db None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:18.495803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397a1d-1cf5-4f5b-a384-a85a2c5118db None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:18.496076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397a1d-1cf5-4f5b-a384-a85a2c5118db None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:18.496777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397a1d-1cf5-4f5b-a384-a85a2c5118db None admin] RBAC: Adding query filter params (name=image) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:18.497084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397a1d-1cf5-4f5b-a384-a85a2c5118db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:18.498504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397a1d-1cf5-4f5b-a384-a85a2c5118db None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:18.508172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 502/993] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:18.509296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:18.567707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:18.613723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc5323-0005-4f6d-9188-a49c22727252 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:18.647558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32b30e-cf56-4de4-950a-e5a626a1c012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:18.648220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32b30e-cf56-4de4-950a-e5a626a1c012 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:18.648504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32b30e-cf56-4de4-950a-e5a626a1c012 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:18.648779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32b30e-cf56-4de4-950a-e5a626a1c012 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:18.649480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32b30e-cf56-4de4-950a-e5a626a1c012 None admin] RBAC: Adding query filter params (type=image) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:18.649786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32b30e-cf56-4de4-950a-e5a626a1c012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:18.651192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32b30e-cf56-4de4-950a-e5a626a1c012 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:18.662511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 492/994] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:18.874395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24da12-0a5b-4059-aafc-472eaa8bd04b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:18.874733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24da12-0a5b-4059-aafc-472eaa8bd04b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:18.874913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24da12-0a5b-4059-aafc-472eaa8bd04b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:18.876260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 503/995] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:18.882675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d46a-c24d-4eb6-8d3d-1316672d4b33 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:18.883113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d46a-c24d-4eb6-8d3d-1316672d4b33 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:18.883526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d46a-c24d-4eb6-8d3d-1316672d4b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:18.906196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b425d46a-c24d-4eb6-8d3d-1316672d4b33 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:18.907742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b425d46a-c24d-4eb6-8d3d-1316672d4b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:18.988634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 493/996] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:19.013121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24da12-0a5b-4059-aafc-472eaa8bd04b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.076628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.117486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24da12-0a5b-4059-aafc-472eaa8bd04b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.153087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.153892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.154175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.154477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.155121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.156620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.159434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906836ae-f81e-4713-90a1-1aa5573cacaf None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.159915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906836ae-f81e-4713-90a1-1aa5573cacaf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.160020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906836ae-f81e-4713-90a1-1aa5573cacaf None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.161598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 494/997] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:19.166515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398512dd-9127-4288-a77b-9e96aa9c1a93 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.166805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398512dd-9127-4288-a77b-9e96aa9c1a93 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.167614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398512dd-9127-4288-a77b-9e96aa9c1a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:19.170975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:19.175539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:19.177151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 504/998] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:19.178967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.192628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-398512dd-9127-4288-a77b-9e96aa9c1a93 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:19.193794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-398512dd-9127-4288-a77b-9e96aa9c1a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:19.243728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.265676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 495/999] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:19.289794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398512dd-9127-4288-a77b-9e96aa9c1a93 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.303752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972bf21-eb08-4238-b3ba-0b31687ba656 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.328114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.338958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.339693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.340052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.340335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.341037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:19.341350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.342777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.347732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 505/1000] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:19.353628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.399412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398512dd-9127-4288-a77b-9e96aa9c1a93 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.436026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.436728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.437007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.437524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.438173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.439557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:19.452581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:19.453593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:19.454482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 496/1001] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:19.459688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.463621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bf134-7194-4062-9bb6-22b43f397ef4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.505143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.505813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.506099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.506409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.507113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:19.507422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.508786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.518327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 506/1002] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:19.518479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.519812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.574981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.577473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad384bf-11e0-46f2-94b3-0b0fc8c7f2a1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.613418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658510-c835-4be0-a157-a83785de0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.614076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658510-c835-4be0-a157-a83785de0812 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.614396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658510-c835-4be0-a157-a83785de0812 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.614902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658510-c835-4be0-a157-a83785de0812 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.615368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658510-c835-4be0-a157-a83785de0812 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:19.615678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658510-c835-4be0-a157-a83785de0812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.617057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658510-c835-4be0-a157-a83785de0812 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.622093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 497/1003] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:19.627628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658510-c835-4be0-a157-a83785de0812 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.631377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a2bc-df3c-48c3-9f72-1df4292d35fb None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.666159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.666842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.667740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.668024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.668750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.670128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.727843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658510-c835-4be0-a157-a83785de0812 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.737882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.751568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 507/1004] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:26:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:19.795939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.796608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.796886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.797158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.797867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:19.798174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.799668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.814031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 498/1005] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:19.814175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:19.927498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333affd-604b-4456-b8a2-a09af8fb285c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:19.941289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.963683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b6023-0232-47fe-8785-20eca9067047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:19.964973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b6023-0232-47fe-8785-20eca9067047 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:19.965259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b6023-0232-47fe-8785-20eca9067047 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:19.965531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b6023-0232-47fe-8785-20eca9067047 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:19.966344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b6023-0232-47fe-8785-20eca9067047 None admin] RBAC: Adding query filter params (interface=public, service_id=e10bfe94a65f4fb589879670f85c0716, region_id=RegionOne) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:19.966723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b6023-0232-47fe-8785-20eca9067047 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:19.968103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b6023-0232-47fe-8785-20eca9067047 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:19.973747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 508/1006] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/endpoints?service_id=e10bfe94a65f4fb589879670f85c0716&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:19.980137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:20.083156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d08b-affe-4599-91f6-6703982b0039 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:20.143021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5dbe0-b355-4263-b867-ce682a51ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:20.143696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5dbe0-b355-4263-b867-ce682a51ffbb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:20.143983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5dbe0-b355-4263-b867-ce682a51ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:20.144265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5dbe0-b355-4263-b867-ce682a51ffbb None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:20.144951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5dbe0-b355-4263-b867-ce682a51ffbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:20.146365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5dbe0-b355-4263-b867-ce682a51ffbb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:20.161926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 499/1007] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:26:19 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:26:20.967579 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2d94c-1e60-4b0a-8b86-34ce4c5cc4ac None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:20.968114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2d94c-1e60-4b0a-8b86-34ce4c5cc4ac None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:20.968114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2d94c-1e60-4b0a-8b86-34ce4c5cc4ac None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:20.969643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 509/1008] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:20.974767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0805-5fd7-4c11-87a1-9b5ee8de0a18 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:20.975125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0805-5fd7-4c11-87a1-9b5ee8de0a18 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:20.975471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0805-5fd7-4c11-87a1-9b5ee8de0a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:20.993525 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3fec0805-5fd7-4c11-87a1-9b5ee8de0a18 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:20.994735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3fec0805-5fd7-4c11-87a1-9b5ee8de0a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:21.028765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:21.070451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 500/1009] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:21.092898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2d94c-1e60-4b0a-8b86-34ce4c5cc4ac None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:21.194922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2d94c-1e60-4b0a-8b86-34ce4c5cc4ac None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:21.228041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b72f78-9543-4b47-b74c-c2bd060d9b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:21.228631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b72f78-9543-4b47-b74c-c2bd060d9b29 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:21.228914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b72f78-9543-4b47-b74c-c2bd060d9b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:21.229192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b72f78-9543-4b47-b74c-c2bd060d9b29 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:21.230037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b72f78-9543-4b47-b74c-c2bd060d9b29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:21.231432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b72f78-9543-4b47-b74c-c2bd060d9b29 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:21.338313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 510/1010] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:26:21 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:22.046958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179a16-db52-4aba-b18d-bcdea0a36950 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.047479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179a16-db52-4aba-b18d-bcdea0a36950 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.047555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179a16-db52-4aba-b18d-bcdea0a36950 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.049030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 501/1011] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:22.054009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f941ea-136e-4f92-901c-a4d14480beaf None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.054421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f941ea-136e-4f92-901c-a4d14480beaf None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.054584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f941ea-136e-4f92-901c-a4d14480beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.071918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-f2f941ea-136e-4f92-901c-a4d14480beaf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:22.073078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f2f941ea-136e-4f92-901c-a4d14480beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:22.103082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:22.147191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 511/1012] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:22 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:22.170703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179a16-db52-4aba-b18d-bcdea0a36950 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:22.284127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179a16-db52-4aba-b18d-bcdea0a36950 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:22.320401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d92a5-4676-4a6f-a9b3-da80fa2c9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:22.321109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d92a5-4676-4a6f-a9b3-da80fa2c9ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.321397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d92a5-4676-4a6f-a9b3-da80fa2c9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.321683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d92a5-4676-4a6f-a9b3-da80fa2c9ed9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.322857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d92a5-4676-4a6f-a9b3-da80fa2c9ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:22.324356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d92a5-4676-4a6f-a9b3-da80fa2c9ed9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:22.330751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 502/1013] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:22.331759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f941ea-136e-4f92-901c-a4d14480beaf None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:22.386585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604c40-fda8-41c2-9a99-abe0d9485881 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.386906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604c40-fda8-41c2-9a99-abe0d9485881 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.387142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604c40-fda8-41c2-9a99-abe0d9485881 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.389201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 503/1014] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:26:22.393904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc9e4-d479-4ddf-8216-917d151d2c64 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.394189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc9e4-d479-4ddf-8216-917d151d2c64 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.394492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc9e4-d479-4ddf-8216-917d151d2c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.411448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ad9fc9e4-d479-4ddf-8216-917d151d2c64 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:22.412609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ad9fc9e4-d479-4ddf-8216-917d151d2c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:22.433660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f941ea-136e-4f92-901c-a4d14480beaf None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:22.437592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:22.470938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:22.471691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.471981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.472249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.472991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:22.474549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:22.494243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 504/1015] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:22 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:22.509589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fc9e4-d479-4ddf-8216-917d151d2c64 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:22.564362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 512/1016] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:26:22 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:26:22.621155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fc9e4-d479-4ddf-8216-917d151d2c64 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:22.659601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:22.660787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.661305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.661786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.662695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:22.664426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:22.677600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:22.678719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:26:22.679569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:22.682374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 505/1017] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:22.686638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:22.705123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:22.797510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c1ae4-1d40-4ab9-8f1a-d39c7c7ee7f5 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:22.832586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:22.833254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.833539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.833819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.834556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:22.834867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:22.836236 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:22.841818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 513/1018] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:26:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:22.848566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:22.875624 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:22.952357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c36aed-e6b1-4b53-b0af-989ac7be0f11 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:22.987883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712e1fc-a1b6-4bfa-b21d-cd947e700429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:22.988550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712e1fc-a1b6-4bfa-b21d-cd947e700429 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:22.988836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712e1fc-a1b6-4bfa-b21d-cd947e700429 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:22.989118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712e1fc-a1b6-4bfa-b21d-cd947e700429 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:22.989821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712e1fc-a1b6-4bfa-b21d-cd947e700429 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:22.990132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712e1fc-a1b6-4bfa-b21d-cd947e700429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:22.991535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712e1fc-a1b6-4bfa-b21d-cd947e700429 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:22.998168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 506/1019] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 19 21:26:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:23.003884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:23.087993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:23.112184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753065b5-90ea-47d4-8152-7e5b5ca89033 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:23.147926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807e580-9b6c-4166-9e60-2c2389d64aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:23.148593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807e580-9b6c-4166-9e60-2c2389d64aff None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:23.148879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807e580-9b6c-4166-9e60-2c2389d64aff None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:23.149164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807e580-9b6c-4166-9e60-2c2389d64aff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:23.150012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807e580-9b6c-4166-9e60-2c2389d64aff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:23.151439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807e580-9b6c-4166-9e60-2c2389d64aff None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:23.274239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 514/1020] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:26:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:23.592433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d753-e342-4894-90dd-705fd8426a7a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:23.592917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d753-e342-4894-90dd-705fd8426a7a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:23.592917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d753-e342-4894-90dd-705fd8426a7a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:23.594415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 507/1021] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:23.599494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ccd1c-818d-4bbd-94aa-d8ffdb5402fc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:23.599785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ccd1c-818d-4bbd-94aa-d8ffdb5402fc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:23.600061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ccd1c-818d-4bbd-94aa-d8ffdb5402fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:23.616827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-656ccd1c-818d-4bbd-94aa-d8ffdb5402fc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:23.617986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-656ccd1c-818d-4bbd-94aa-d8ffdb5402fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:23.689839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 515/1022] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:23.712309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d753-e342-4894-90dd-705fd8426a7a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:23.805522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:23.818615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d753-e342-4894-90dd-705fd8426a7a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:23.854076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:23.854856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:23.855137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:23.855408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] PATH_INFO: `/v3/services/image` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:23.856054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:23.857413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:23.868960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:23.870763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:23.871640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 508/1023] 10.222.0.59 () {56 vars in 1105 bytes} [Thu May 19 21:26:23 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:23.879488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ccd1c-818d-4bbd-94aa-d8ffdb5402fc None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:23.947109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:23.987378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ccd1c-818d-4bbd-94aa-d8ffdb5402fc None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:24.022356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:24.023016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:24.023301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:24.023574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:24.024263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] RBAC: Adding query filter params (name=image) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:24.024565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:24.025979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:24.034518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 516/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:24.036586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:24.136042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9e4eb-9145-4551-83f6-bf4562cce495 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:24.170324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:24.170984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:24.171263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:24.171533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:24.172228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] RBAC: Adding query filter params (type=image) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:24.172531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:24.173889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:24.183645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 509/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:24.184873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:24.286309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362e21-642d-4ded-b75d-1f00d78cd27b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:24.311923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:24.322804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a2ddb-2ef8-42c4-8df1-8bf0398b5715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:24.323967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2ddb-2ef8-42c4-8df1-8bf0398b5715 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:24.324244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2ddb-2ef8-42c4-8df1-8bf0398b5715 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:24.324512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2ddb-2ef8-42c4-8df1-8bf0398b5715 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:24.325281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2ddb-2ef8-42c4-8df1-8bf0398b5715 None admin] RBAC: Adding query filter params (interface=public, service_id=15b077cbe5344e7493552f4db9e846a4, region_id=RegionOne) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:24.325589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2ddb-2ef8-42c4-8df1-8bf0398b5715 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:24.327007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2ddb-2ef8-42c4-8df1-8bf0398b5715 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:24.336305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 517/1026] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:26:24 2022] GET /identity/v3/endpoints?service_id=15b077cbe5344e7493552f4db9e846a4&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:24.337876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:24.357698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:24.439426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb2381-b73a-4f2f-9afe-03f99268f025 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:24.473351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9626cb-7b31-4fc6-9bc9-f1cc81bf15b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:24.474013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9626cb-7b31-4fc6-9bc9-f1cc81bf15b3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:24.474321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9626cb-7b31-4fc6-9bc9-f1cc81bf15b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:24.474598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9626cb-7b31-4fc6-9bc9-f1cc81bf15b3 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:24.475267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9626cb-7b31-4fc6-9bc9-f1cc81bf15b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:24.476618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9626cb-7b31-4fc6-9bc9-f1cc81bf15b3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:24.486460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 510/1027] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:26:24 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:26:24.856086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f251bc1-5b08-4aee-b7a1-de3e69f5446f None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:24.856396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f251bc1-5b08-4aee-b7a1-de3e69f5446f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:24.856579 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f251bc1-5b08-4aee-b7a1-de3e69f5446f None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:24.858074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 518/1028] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:24.864067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102d75-030c-42ff-a090-36fe09fd3ee7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:24.864790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102d75-030c-42ff-a090-36fe09fd3ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:24.865046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102d75-030c-42ff-a090-36fe09fd3ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:24.882450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-89102d75-030c-42ff-a090-36fe09fd3ee7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:24.883631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-89102d75-030c-42ff-a090-36fe09fd3ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:24.951322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 511/1029] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:24.975327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f251bc1-5b08-4aee-b7a1-de3e69f5446f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:25.090737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f251bc1-5b08-4aee-b7a1-de3e69f5446f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:25.123651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a80ea4-fb4f-4af5-b3e8-8e3c3fa88d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:25.124355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a80ea4-fb4f-4af5-b3e8-8e3c3fa88d2a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:25.124633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a80ea4-fb4f-4af5-b3e8-8e3c3fa88d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:25.124902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a80ea4-fb4f-4af5-b3e8-8e3c3fa88d2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:25.126076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a80ea4-fb4f-4af5-b3e8-8e3c3fa88d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:25.127529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a80ea4-fb4f-4af5-b3e8-8e3c3fa88d2a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:25.129384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 519/1030] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:25.134835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89102d75-030c-42ff-a090-36fe09fd3ee7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:25.148261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:25.237506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89102d75-030c-42ff-a090-36fe09fd3ee7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:25.272121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12201f3f-0996-40df-bd84-0c09f76b1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:25.272788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12201f3f-0996-40df-bd84-0c09f76b1c93 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:25.273070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12201f3f-0996-40df-bd84-0c09f76b1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:25.273341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12201f3f-0996-40df-bd84-0c09f76b1c93 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:25.274073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12201f3f-0996-40df-bd84-0c09f76b1c93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:25.275550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12201f3f-0996-40df-bd84-0c09f76b1c93 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:25.390245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 512/1031] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:26:25 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:26:25.625698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ff0b-0e57-43ac-b095-cd5f037e7253 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:25.626302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ff0b-0e57-43ac-b095-cd5f037e7253 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:25.626415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ff0b-0e57-43ac-b095-cd5f037e7253 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:25.628011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 520/1032] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:25.633096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd064e-2f2d-4612-b1e8-f8cd61437123 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:25.633387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd064e-2f2d-4612-b1e8-f8cd61437123 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:25.633667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd064e-2f2d-4612-b1e8-f8cd61437123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:25.651673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3bcd064e-2f2d-4612-b1e8-f8cd61437123 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:25.652783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3bcd064e-2f2d-4612-b1e8-f8cd61437123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:25.715375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:25.726268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 513/1033] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:25.747575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ff0b-0e57-43ac-b095-cd5f037e7253 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:25.809234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:25.862870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ff0b-0e57-43ac-b095-cd5f037e7253 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:25.899217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:25.900023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:25.900308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:25.900583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:25.910906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:25.919930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:25.920835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:25.921689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 521/1034] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 19 21:26:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:25.928306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd064e-2f2d-4612-b1e8-f8cd61437123 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.030675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd064e-2f2d-4612-b1e8-f8cd61437123 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:26.071671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:26.072392 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.072677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.073481 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.074249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:26.074560 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:26.075938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:26.088375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 514/1035] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 19 21:26:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:26.090151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.207284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c7e1-af92-4bc7-bec0-dc624862d562 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:26.223846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:26.241724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:26.242557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.242846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.243126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.254339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:26.255810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:26.274083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:26.275175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:26.276105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:26.276105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:26.276105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:26.276105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:26.282256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 522/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:26.282924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.350038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:26.392774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f56b-2e3a-42ee-9bc5-b9bc5f0f504c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:26.426191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:26.426935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.427227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.427509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.428280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:26.428596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:26.429969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:26.446250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 515/1037] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:26.449241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.555424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258c8a-c0e5-4a94-bf54-7eb2abe4cf64 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:26.591182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa19e66-a199-4e39-b651-acce7f5309fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:26.591986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19e66-a199-4e39-b651-acce7f5309fe None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.592272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19e66-a199-4e39-b651-acce7f5309fe None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.592551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19e66-a199-4e39-b651-acce7f5309fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.601375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa19e66-a199-4e39-b651-acce7f5309fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:26.602857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa19e66-a199-4e39-b651-acce7f5309fe None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-5fa19e66-a199-4e39-b651-acce7f5309fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:26:26.617631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:26.618792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:26.619792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 523/1038] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:26:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:26.626706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.700243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e30c4-c10c-4960-8eb0-ec0cfa38ccc8 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.700760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e30c4-c10c-4960-8eb0-ec0cfa38ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.700760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e30c4-c10c-4960-8eb0-ec0cfa38ccc8 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.702285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 524/1039] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:26.707280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c1fa-e0fe-42c5-8f9d-826a2ba3aa66 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.707564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c1fa-e0fe-42c5-8f9d-826a2ba3aa66 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.707844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c1fa-e0fe-42c5-8f9d-826a2ba3aa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.725318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-27e3c1fa-e0fe-42c5-8f9d-826a2ba3aa66 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:26.726604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-27e3c1fa-e0fe-42c5-8f9d-826a2ba3aa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:26.730857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f2d5-bb24-4520-ad56-25e38b0b2d69 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:26.748924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:26.752900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:26.765651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:26.766349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.766632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.767021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.767739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:26.768050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:26.769481 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:26.787637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 516/1040] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:26:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:26.793626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.801428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 525/1041] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:26.824599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c1fa-e0fe-42c5-8f9d-826a2ba3aa66 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.899731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327968c4-c88d-4e29-aafa-af062edb1f4f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:26.923464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c1fa-e0fe-42c5-8f9d-826a2ba3aa66 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:26.936042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:26.936837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.937382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.937658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.958185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:26.958992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:26.959271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:26.959539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] PATH_INFO: `/v3/services/image` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:26.960182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:26.961533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:26.973624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:26.974651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:26.976655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 526/1042] 10.222.0.59 () {56 vars in 1105 bytes} [Thu May 19 21:26:26 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:26.981310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:26.987779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.005768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.011426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.012905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.081617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e39a-1832-43b8-aa5a-6dcb46ca074d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.119287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:27.119990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.120278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.120559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.121270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] RBAC: Adding query filter params (name=image) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:27.121583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.122992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.123633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 517/1043] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:26:27.128979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.133348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 527/1044] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:27.139202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.207241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.230553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377df94-b024-4aca-8639-16e3bc5faf9b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.236525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.253031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2baa81-3615-42ff-8abc-767d0ae04a9e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.267186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:27.268477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.268874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.269154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.285223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.289307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.291344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:27.292400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.292690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.292970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.293681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] RBAC: Adding query filter params (type=image) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:27.294019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.295446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.301488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 528/1045] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:27.306821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:27.307433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:27.308279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:27.309148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:27.309148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:27.309148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:27.309148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:27.311354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 518/1046] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:27.314256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.411337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611945b-788f-44ed-9fbd-7ec7bafae7bc None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.421188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c606bbf-165a-4e3f-b60a-9ee864e016f4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.446849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:27.447502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.447779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.448584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.449319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.449478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.450736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.457141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:27.457822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.458203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.464234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.464234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:27.464234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.464234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.472711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 519/1047] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:27.478195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.574241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 529/1048] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:26:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:26:27.600379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd825-5eb4-4dc6-aa70-9f3486dc5627 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.646167 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9086f-108d-4aaf-a721-bb4f8eb23272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:27.647118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9086f-108d-4aaf-a721-bb4f8eb23272 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.647411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9086f-108d-4aaf-a721-bb4f8eb23272 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.647689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9086f-108d-4aaf-a721-bb4f8eb23272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.655674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9086f-108d-4aaf-a721-bb4f8eb23272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.657224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9086f-108d-4aaf-a721-bb4f8eb23272 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-81b9086f-108d-4aaf-a721-bb4f8eb23272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:27.673161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:27.674083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:27.675737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 520/1049] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:27.680141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.690785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.733661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455b0e-fbe8-4acf-83a3-5bbcf057cb7b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.733951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455b0e-fbe8-4acf-83a3-5bbcf057cb7b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.734255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455b0e-fbe8-4acf-83a3-5bbcf057cb7b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.735680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 521/1050] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:27.741257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803416e-1011-483a-954e-ae1c852589f7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.741551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803416e-1011-483a-954e-ae1c852589f7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.741837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803416e-1011-483a-954e-ae1c852589f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.761600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c803416e-1011-483a-954e-ae1c852589f7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:27.762845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c803416e-1011-483a-954e-ae1c852589f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:27.794092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b4f0d-5a69-499f-bc65-583fe895505f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.817206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.836189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:27.836871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:27.837149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:27.837423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:27.838245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:27.838589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:27.840044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:27.845849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 522/1051] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:27.860514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 530/1052] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:27.861981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803416e-1011-483a-954e-ae1c852589f7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.870536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:27.941212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:27.967462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803416e-1011-483a-954e-ae1c852589f7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:27.975985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163d0a-219f-4421-91c7-e2ebc30049fd None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:28.003437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:28.004264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:28.004650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:28.005033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:28.005874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] RBAC: Adding query filter params (role.id=73cf35c851a1440e98ee386240aed18e, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=37df82be35a448bf819e4f157741b8f1) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:28.006195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:28.007659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:28.012454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:28.013243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:28.013523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:28.013797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:28.022715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 523/1053] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:27 2022] GET /identity/v3/role_assignments?user.id=37df82be35a448bf819e4f157741b8f1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=73cf35c851a1440e98ee386240aed18e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:28.033059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:28.040942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:28.042609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:28.043445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 531/1054] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:28.051593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:28.098491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:28.167545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46201cc4-3a98-470c-922f-5b3dc8449555 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:28.206256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:28.206864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:28.207152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:28.207433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:28.208183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:28.208496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:28.209881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:28.220074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 524/1055] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:28.226098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:28.350925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc8731-79b1-43f1-94f5-012788b5cf4e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:28.376594 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:28.386138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:28.387042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:28.387326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:28.387601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] PATH_INFO: `/v3/users/5a49316b869a4cdbaaa6fd9889ac2304` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:28.401160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] RBAC: Authorizing `identity:get_user(user_id=5a49316b869a4cdbaaa6fd9889ac2304)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:28.402651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:28.404619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 532/1056] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:28 2022] GET /identity/v3/users/5a49316b869a4cdbaaa6fd9889ac2304 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:28.410347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:28.509596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:28.513775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84f4e-4578-40ab-8d54-0df2840a971c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:28.547022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:28.547673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:28.547966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:28.548243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:28.636078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:28.637540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:28.731889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:28.741188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 525/1057] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:26:28.742773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:28.844348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2fb33-1376-48eb-b85f-08ea5c522082 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:28.879941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151f10a-ec97-4c74-91fa-590171d37fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:28.880801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f10a-ec97-4c74-91fa-590171d37fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:28.881094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f10a-ec97-4c74-91fa-590171d37fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:28.881369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f10a-ec97-4c74-91fa-590171d37fd6 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:28.882584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151f10a-ec97-4c74-91fa-590171d37fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=0390720680ad4a07aeb4ef48e364ee9b)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:28.884035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151f10a-ec97-4c74-91fa-590171d37fd6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:28.890748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 533/1058] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:28 2022] GET /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:28.891809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:28.992804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e779f7f-03ca-4ac5-96d6-742b069e2c67 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:29.026497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5c1e2-57bf-4459-8e34-1552a33a0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:29.027148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c1e2-57bf-4459-8e34-1552a33a0316 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:29.027433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c1e2-57bf-4459-8e34-1552a33a0316 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:29.027710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c1e2-57bf-4459-8e34-1552a33a0316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:29.028552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5c1e2-57bf-4459-8e34-1552a33a0316 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=0390720680ad4a07aeb4ef48e364ee9b, user.id=5a49316b869a4cdbaaa6fd9889ac2304) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:29.028865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5c1e2-57bf-4459-8e34-1552a33a0316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:29.030320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5c1e2-57bf-4459-8e34-1552a33a0316 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:29.042517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 526/1059] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:28 2022] GET /identity/v3/role_assignments?user.id=5a49316b869a4cdbaaa6fd9889ac2304&scope.project.id=0390720680ad4a07aeb4ef48e364ee9b&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:29.872310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926a81-293d-4828-8e0a-1fc8f6a90965 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:29.872937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926a81-293d-4828-8e0a-1fc8f6a90965 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:29.872937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926a81-293d-4828-8e0a-1fc8f6a90965 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:29.874249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 534/1060] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:29.879611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e346f8-f28c-44b6-9f93-041ddf61bc45 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:29.879911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e346f8-f28c-44b6-9f93-041ddf61bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:29.880195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e346f8-f28c-44b6-9f93-041ddf61bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:29.896783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c2e346f8-f28c-44b6-9f93-041ddf61bc45 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:29.897955 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c2e346f8-f28c-44b6-9f93-041ddf61bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:29.957688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:29.967185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 527/1061] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:29.989785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926a81-293d-4828-8e0a-1fc8f6a90965 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:30.043694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:30.093818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926a81-293d-4828-8e0a-1fc8f6a90965 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:30.130242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:30.130903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.131191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.131467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.204346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:30.205831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:30.258194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:30.270490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990146-9336-4ce9-bc9a-3020f22bb430 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.277660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990146-9336-4ce9-bc9a-3020f22bb430 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.277660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990146-9336-4ce9-bc9a-3020f22bb430 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.277660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 528/1062] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:30.281546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5481aa-e2b3-4f40-946d-83e067953f0d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.281546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5481aa-e2b3-4f40-946d-83e067953f0d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.281546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5481aa-e2b3-4f40-946d-83e067953f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.300380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0e5481aa-e2b3-4f40-946d-83e067953f0d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:30.301859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0e5481aa-e2b3-4f40-946d-83e067953f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:30.313990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 535/1063] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:26:30.319742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:30.370944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 529/1064] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:30.393401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5481aa-e2b3-4f40-946d-83e067953f0d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:30.427032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3a29-45ba-4fc4-89de-40e88b05cc39 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:30.462596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:30.463709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.464181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.464651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.475751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:30.477409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:30.496999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:30.497966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:30.498985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:30.498985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:30.498985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:30.498985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:30.499853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5481aa-e2b3-4f40-946d-83e067953f0d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:30.503197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 536/1065] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:30.503837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:30.507274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:30.524017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:30.534158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:30.535005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.535291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.535570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.546378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:30.554575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:30.555601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:30.556482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 530/1066] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 19 21:26:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:30.562564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:30.610556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78777-13f3-4e5e-84f0-46beb21d1a7f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:30.646712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:30.647407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.647685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.648081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.648783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:30.649085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:30.650460 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:30.670243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c692-0e7f-4953-bf4c-60817270e155 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:30.670451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 537/1067] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:30.707705 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:30.708389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.708676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.708953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.709708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:30.710020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:30.711465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:30.725332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 531/1068] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 19 21:26:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:30.733393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:30.800659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:30.852795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce9d0e-0914-4e5f-afd4-efb6e373e0db None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:30.890270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:30.891072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:30.891355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:30.891628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:30.903990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:30.905368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:30.924289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:30.926675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:30.927586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:30.927586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:30.927586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:30.927586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:30.927586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 538/1069] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:30.931420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:30.982515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:31.038578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f7098-08d3-483f-be9c-a1c7f6546a9a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.071740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.072398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.073276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.073556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.074303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:31.074613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.075974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.093616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 532/1070] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:31.094812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.207293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9045f5-6b95-45c6-8751-2f9b67413f3d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.223772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:31.242114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f95937-2a6f-4df6-b8ee-c41999a3628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.242934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95937-2a6f-4df6-b8ee-c41999a3628e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.243297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95937-2a6f-4df6-b8ee-c41999a3628e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.243669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95937-2a6f-4df6-b8ee-c41999a3628e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.255281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f95937-2a6f-4df6-b8ee-c41999a3628e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.257073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f95937-2a6f-4df6-b8ee-c41999a3628e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-12f95937-2a6f-4df6-b8ee-c41999a3628e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:26:31.276567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:31.277608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:31.278757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 539/1071] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:31.284069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.319838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039881aa-81d8-4181-9060-ef78490eef01 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.320129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039881aa-81d8-4181-9060-ef78490eef01 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.320410 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039881aa-81d8-4181-9060-ef78490eef01 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.321779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 540/1072] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:26:31.327298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e224-0d0b-4f42-a63f-943b8b9941ad None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.327589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e224-0d0b-4f42-a63f-943b8b9941ad None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.327870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e224-0d0b-4f42-a63f-943b8b9941ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.345916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c9b8e224-0d0b-4f42-a63f-943b8b9941ad None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:31.347155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c9b8e224-0d0b-4f42-a63f-943b8b9941ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:31.394907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41dec4-fd77-4b36-b41b-bcddd78b589a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.403376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:31.424440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 541/1073] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:31.433145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.433814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.434101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.434407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.435245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:31.435557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.437244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.448437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e224-0d0b-4f42-a63f-943b8b9941ad None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.457760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 533/1074] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:31.463461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.553066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e224-0d0b-4f42-a63f-943b8b9941ad None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.560902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:31.569286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13acc-036f-49c2-8372-426b457f4a2b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.587609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.588428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.588715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.588996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.599283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:31.603295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.604140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.604414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.604690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:31.606975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:31.608010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:31.608860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 542/1075] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:31.614191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.614885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.616323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:31.634051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:31.635216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:31.636626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:31.636626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:31.636626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:31.636626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:31.636626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 534/1076] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:31.641321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.658671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:31.717533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1631de-0dfe-439e-b00f-c56c1fb47820 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.741531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c65a5-b09d-40f8-aaa5-033214f25ef1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.750081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.750773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.751058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.751335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.752070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:31.752376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.753737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.762357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 543/1077] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:31.768130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.775575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.776845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.777124 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.777397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.778105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:31.778438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.779792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.790796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 535/1078] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:31.795906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:31.796766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.867912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603adc9-9879-4ea0-ad28-fa83fe19b2c6 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.872004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:31.895034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cba77-8b87-4a49-b595-cad0fbb01d4c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:31.901704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.902702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.903047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.903339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] PATH_INFO: `/v3/users/5a49316b869a4cdbaaa6fd9889ac2304` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.904513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] RBAC: Authorizing `identity:get_user(user_id=5a49316b869a4cdbaaa6fd9889ac2304)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.905983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.907831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 544/1079] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/users/5a49316b869a4cdbaaa6fd9889ac2304 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:31.913123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:31.929173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:31.929972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:31.930287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:31.930570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:31.937467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:31.938943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:31.953353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:31.954307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:31.955429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 536/1080] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:31.960058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:32.007346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:32.013667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01834-1d28-425a-9ca1-50f6940dbe8f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:32.047481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:32.048341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:32.048621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:32.048898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:32.050059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] RBAC: Authorizing `identity:get_project(project_id=0390720680ad4a07aeb4ef48e364ee9b)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:32.051521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:32.053229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 545/1081] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:32.058663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14c63-326f-475e-b556-ab13be8a05a1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:32.058971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:32.093600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:32.094272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:32.094560 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:32.094839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:32.095617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:32.095934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:32.097373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:32.099938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:32.109583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 537/1082] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:32.115092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:32.161348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828654-7c5a-430f-97c6-f2075a5c3252 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:32.194379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a849cd-8832-4049-bbb7-aefefbf87439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:32.195255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a849cd-8832-4049-bbb7-aefefbf87439 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:32.195539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a849cd-8832-4049-bbb7-aefefbf87439 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:32.195818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a849cd-8832-4049-bbb7-aefefbf87439 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b/users/5a49316b869a4cdbaaa6fd9889ac2304/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:32.198380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a849cd-8832-4049-bbb7-aefefbf87439 None admin] RBAC: Authorizing `identity:create_grant(project_id=0390720680ad4a07aeb4ef48e364ee9b, user_id=5a49316b869a4cdbaaa6fd9889ac2304, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:32.199818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a849cd-8832-4049-bbb7-aefefbf87439 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:32.214604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1394-3d0c-483a-a771-f2a3be0dc645 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:32.247835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a604f47-4744-47a3-998d-7a6ee8f698b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:32.248709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604f47-4744-47a3-998d-7a6ee8f698b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:32.248988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604f47-4744-47a3-998d-7a6ee8f698b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:32.249257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604f47-4744-47a3-998d-7a6ee8f698b5 None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/37df82be35a448bf819e4f157741b8f1/roles/73cf35c851a1440e98ee386240aed18e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:32.251461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a604f47-4744-47a3-998d-7a6ee8f698b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=37df82be35a448bf819e4f157741b8f1, role_id=73cf35c851a1440e98ee386240aed18e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:32.252920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a604f47-4744-47a3-998d-7a6ee8f698b5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:32.290517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 546/1083] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:26:32 2022] PUT /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b/users/5a49316b869a4cdbaaa6fd9889ac2304/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:26:32.348980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 538/1084] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:26:32 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/37df82be35a448bf819e4f157741b8f1/roles/73cf35c851a1440e98ee386240aed18e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:26:34.515764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cab4e-9b72-4915-990a-9f32ac48457d None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:34.516330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cab4e-9b72-4915-990a-9f32ac48457d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:34.516330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cab4e-9b72-4915-990a-9f32ac48457d None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:34.517662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 547/1085] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:34.523032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b901210-1134-4293-ab11-0ed27b587fb0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:34.523424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b901210-1134-4293-ab11-0ed27b587fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:34.523600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b901210-1134-4293-ab11-0ed27b587fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:34.540766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9b901210-1134-4293-ab11-0ed27b587fb0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:34.542479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9b901210-1134-4293-ab11-0ed27b587fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:34.592441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:34.600959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f5735-c2ba-41dd-a55c-c5e9e1e260b4 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:34.601250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f5735-c2ba-41dd-a55c-c5e9e1e260b4 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:34.601532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f5735-c2ba-41dd-a55c-c5e9e1e260b4 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:34.602963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 548/1086] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:26:34.608402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c370b-d6a9-4da5-9f3c-1f36666af5bf None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:34.608688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c370b-d6a9-4da5-9f3c-1f36666af5bf None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:34.608964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c370b-d6a9-4da5-9f3c-1f36666af5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:34.609580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 539/1087] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:34.625257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-d10c370b-d6a9-4da5-9f3c-1f36666af5bf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:34.626451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d10c370b-d6a9-4da5-9f3c-1f36666af5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:34.631912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b901210-1134-4293-ab11-0ed27b587fb0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:34.644048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:34.692154 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 549/1088] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:34.724072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c370b-d6a9-4da5-9f3c-1f36666af5bf None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:34.731677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b901210-1134-4293-ab11-0ed27b587fb0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:34.766843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:34.767634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:34.767920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:34.768202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:34.779231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:34.786914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:34.787855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:34.788715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 540/1089] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:34.794141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:34.827891 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c370b-d6a9-4da5-9f3c-1f36666af5bf None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:34.840946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:34.861570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:34.862409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:34.862698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:34.862974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:34.873483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:34.881474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:34.882457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:34.883313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 550/1090] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 19 21:26:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:26:34.889241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:34.894818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79edc5-fde3-4794-a7e4-07a62dcfe004 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:34.905137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:34.929607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:34.930298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:34.930589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:34.930869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:34.931607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:34.931916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:34.933314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:34.941741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 541/1091] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:34.950044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:34.989807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0039b7-2b18-4225-b6cb-acee3594530c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.022859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.023521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.023805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.024082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.024820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:35.025130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.027117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.034841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 551/1092] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 19 21:26:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:35.040527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.047876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f25e3-48fd-42c5-8607-065dcf4cf8aa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.057447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:35.088010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.089490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.090046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.090538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] PATH_INFO: `/v3/users/5a49316b869a4cdbaaa6fd9889ac2304` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.091850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] RBAC: Authorizing `identity:get_user(user_id=5a49316b869a4cdbaaa6fd9889ac2304)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.093893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.095255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 542/1093] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:34 2022] GET /identity/v3/users/5a49316b869a4cdbaaa6fd9889ac2304 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:35.100782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.125761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:35.150080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218ca21-437b-49ee-b3a6-1dae1e6bdf05 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.192104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.193045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.193418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.193815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.205457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.206938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.212112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14880993-3998-453d-9ee1-cab82d1ea31f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:35.223999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:35.225075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:35.225972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:35.225972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:35.225972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:35.225972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:35.225972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 552/1094] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:35.230799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.250054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.250732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.251144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.251426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.302848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:35.326380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.327856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.331266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4f51-ad67-4e98-b348-6bc482ff47c4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.356889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:35.365428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.366118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.366426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.366703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.367428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:35.367732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.369865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.391278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 553/1095] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:35.392694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.505272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 543/1096] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:26:35.511561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.570837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d98ba-1b15-42a0-a1a9-1a684e637805 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.587590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:35.604715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.605502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.605786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.606064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.611314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcf349-c8f5-4b8e-b9d0-47642ebf09ce None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.613009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.614698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:26:35.628935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:35.631969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:35.632987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 554/1097] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:35.636258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.646490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.647339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.647626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.647903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.649163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] RBAC: Authorizing `identity:get_project(project_id=0390720680ad4a07aeb4ef48e364ee9b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.651174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.658114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 544/1098] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:35.658877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.692737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:35.755075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518fa72-58b7-4e15-a165-90513fcdd262 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.767870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb129-07f9-4da5-8d99-8e4e7cf7e620 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.789334 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.790001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.790317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.790596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.791452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:35.791767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.793207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.800989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.801630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.801910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.802183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:35.803018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=0390720680ad4a07aeb4ef48e364ee9b, user.id=5a49316b869a4cdbaaa6fd9889ac2304) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:35.803328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:35.804722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:35.809889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 555/1099] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:35.814943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 545/1100] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/role_assignments?user.id=5a49316b869a4cdbaaa6fd9889ac2304&scope.project.id=0390720680ad4a07aeb4ef48e364ee9b&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:26:35.816157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:35.919999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1bad0-3667-435f-8289-e1d038ddf872 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:35.928480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:35.958735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:35.959404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:35.959824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:35.960462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:36.031103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:36.032578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:36.135977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 556/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:26:36.141621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:36.152165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:36.240953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3994fc-b787-4655-870f-69be48c6e5e3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:36.274789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:36.275582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:36.275869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:36.276144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:36.292010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:36.293470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:26:36.311492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:36.312685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:36.314051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:26:36.314051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:26:36.314051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:26:36.314051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:36.314051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 546/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:36.318728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:36.326868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:36.416709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd9a0b-68ba-4303-91c2-bd9634b361a4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:36.450172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:36.450848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:36.451128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:36.451402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:36.452107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:36.452415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:36.453833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:36.464696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 557/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:36.470195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:36.528460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:36.568740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7314f0-0a7b-4015-9e08-1905d24f9829 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:36.603739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:36.604531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:36.604818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:36.605101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:36.611692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:36.613122 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:26:36.627157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:36.628048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:26:36.628932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:26:36.630522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 547/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:36.634105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:36.698841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:36.732783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3f4a-d37e-4dbc-83f3-dfddeeae899b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:36.764925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d94fb4-47d0-44b6-b9d5-b917ecb8e0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:36.765576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94fb4-47d0-44b6-b9d5-b917ecb8e0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:36.765863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94fb4-47d0-44b6-b9d5-b917ecb8e0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:36.766141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94fb4-47d0-44b6-b9d5-b917ecb8e0e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:36.766966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94fb4-47d0-44b6-b9d5-b917ecb8e0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:36.767277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94fb4-47d0-44b6-b9d5-b917ecb8e0e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:36.768737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94fb4-47d0-44b6-b9d5-b917ecb8e0e7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:36.780926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 558/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:26:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:36.786778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:36.884717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d636a7-1970-40d7-b026-a178d36b17eb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:36.904336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:36.917802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad80b7-f3d7-45b5-9451-f4d4c8425917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:36.918480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad80b7-f3d7-45b5-9451-f4d4c8425917 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:36.918768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad80b7-f3d7-45b5-9451-f4d4c8425917 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:36.919043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad80b7-f3d7-45b5-9451-f4d4c8425917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:36.919859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad80b7-f3d7-45b5-9451-f4d4c8425917 None admin] RBAC: Adding query filter params (role.id=73cf35c851a1440e98ee386240aed18e, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=37df82be35a448bf819e4f157741b8f1) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:36.920171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad80b7-f3d7-45b5-9451-f4d4c8425917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:36.921602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad80b7-f3d7-45b5-9451-f4d4c8425917 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:36.927337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 548/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:36 2022] GET /identity/v3/role_assignments?user.id=37df82be35a448bf819e4f157741b8f1&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=73cf35c851a1440e98ee386240aed18e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:38.051889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d056cf-9221-405c-9e86-ebafe540f8b7 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:38.052450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d056cf-9221-405c-9e86-ebafe540f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:38.052450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d056cf-9221-405c-9e86-ebafe540f8b7 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:38.053799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 559/1107] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:38.059099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ca7f-ce6c-454b-b49f-66f37224fc7d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:38.059472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ca7f-ce6c-454b-b49f-66f37224fc7d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:38.059653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ca7f-ce6c-454b-b49f-66f37224fc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:38.076651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d529ca7f-ce6c-454b-b49f-66f37224fc7d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:38.077811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d529ca7f-ce6c-454b-b49f-66f37224fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:38.143443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 549/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:38.167302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d056cf-9221-405c-9e86-ebafe540f8b7 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:38.264951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d056cf-9221-405c-9e86-ebafe540f8b7 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:38.289565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:38.298105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16822cb-b99f-4bca-9674-0137a68c315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:38.303646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16822cb-b99f-4bca-9674-0137a68c315e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:38.303646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16822cb-b99f-4bca-9674-0137a68c315e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:38.303646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16822cb-b99f-4bca-9674-0137a68c315e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:38.303646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16822cb-b99f-4bca-9674-0137a68c315e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:38.303646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16822cb-b99f-4bca-9674-0137a68c315e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:38.303646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 560/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:38.309430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529ca7f-ce6c-454b-b49f-66f37224fc7d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:38.404543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529ca7f-ce6c-454b-b49f-66f37224fc7d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:38.418347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:38.437695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8fe40-9cd4-4565-972a-97119471d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:38.438396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8fe40-9cd4-4565-972a-97119471d255 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:38.438683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8fe40-9cd4-4565-972a-97119471d255 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:38.438960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8fe40-9cd4-4565-972a-97119471d255 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:38.439681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8fe40-9cd4-4565-972a-97119471d255 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:38.441112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8fe40-9cd4-4565-972a-97119471d255 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:38.532917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 550/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:26:38 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:26:40.766884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0b24-e43f-4003-86b1-4a0955610aa1 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:40.767412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0b24-e43f-4003-86b1-4a0955610aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:40.767504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0b24-e43f-4003-86b1-4a0955610aa1 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:40.768800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 561/1111] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:40.774031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c90e8-e8a3-49cf-8a42-ff002a5ab392 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:40.774438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c90e8-e8a3-49cf-8a42-ff002a5ab392 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:40.774644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c90e8-e8a3-49cf-8a42-ff002a5ab392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:40.791445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-654c90e8-e8a3-49cf-8a42-ff002a5ab392 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:40.792619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-654c90e8-e8a3-49cf-8a42-ff002a5ab392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:40.857441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 551/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:40.880706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0b24-e43f-4003-86b1-4a0955610aa1 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:40.977910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0b24-e43f-4003-86b1-4a0955610aa1 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:41.011865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:41.012704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:41.012987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:41.013272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] PATH_INFO: `/v3/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:41.014751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] RBAC: Authorizing `identity:get_role(role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:41.016117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:41.017519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 562/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:40 2022] GET /identity/v3/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:41.023098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c90e8-e8a3-49cf-8a42-ff002a5ab392 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:41.114940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:41.117548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c90e8-e8a3-49cf-8a42-ff002a5ab392 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:41.151255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:41.152108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:41.152388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:41.152661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] PATH_INFO: `/v3/users/017a46a5bec5420b9a5c945ccc024acc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:41.165323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] RBAC: Authorizing `identity:get_user(user_id=017a46a5bec5420b9a5c945ccc024acc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:41.167407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:41.169007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 552/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:41 2022] GET /identity/v3/users/017a46a5bec5420b9a5c945ccc024acc => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:41.174711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:41.249616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:41.287600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522894d6-c2b3-45c9-8b3c-c3f71c17b151 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:41.321437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:41.322079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:41.322401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:41.322685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:41.387262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:41.388731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:41.459741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:41.499411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 563/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:26:41.505272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:41.601482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea6ac8-d981-4c27-881d-6aa4a08bc030 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:41.634661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b97d-fef8-4379-8568-130e3713bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:41.635505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b97d-fef8-4379-8568-130e3713bb93 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:41.635783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b97d-fef8-4379-8568-130e3713bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:41.636055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b97d-fef8-4379-8568-130e3713bb93 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:41.637216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b97d-fef8-4379-8568-130e3713bb93 None admin] RBAC: Authorizing `identity:get_project(project_id=0390720680ad4a07aeb4ef48e364ee9b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:41.638657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b97d-fef8-4379-8568-130e3713bb93 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:41.640316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 553/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:41 2022] GET /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:41.646267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:41.741230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e7bf8-495f-4906-b26f-4da258fa380e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:41.774295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3951-75d8-432e-b91d-3a513de00582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:41.774950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3951-75d8-432e-b91d-3a513de00582 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:41.775249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3951-75d8-432e-b91d-3a513de00582 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:41.775529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3951-75d8-432e-b91d-3a513de00582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:41.776365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac3951-75d8-432e-b91d-3a513de00582 None admin] RBAC: Adding query filter params (role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=0390720680ad4a07aeb4ef48e364ee9b, user.id=017a46a5bec5420b9a5c945ccc024acc) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:41.776681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac3951-75d8-432e-b91d-3a513de00582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:41.778145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac3951-75d8-432e-b91d-3a513de00582 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:41.785147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 564/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:41 2022] GET /identity/v3/role_assignments?user.id=017a46a5bec5420b9a5c945ccc024acc&scope.project.id=0390720680ad4a07aeb4ef48e364ee9b&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:43.926814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ec28-4848-4428-b648-c2d284629fe8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:43.927366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ec28-4848-4428-b648-c2d284629fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:43.927366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ec28-4848-4428-b648-c2d284629fe8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:43.928749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 554/1118] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:43.934365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614e332-9291-4278-850c-0662d4836c9d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:43.934795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614e332-9291-4278-850c-0662d4836c9d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:43.934915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614e332-9291-4278-850c-0662d4836c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:43.951602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a614e332-9291-4278-850c-0662d4836c9d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:43.952793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a614e332-9291-4278-850c-0662d4836c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:43.972241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:44.017852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 565/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:44.040490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ec28-4848-4428-b648-c2d284629fe8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:44.078514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:44.146284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ec28-4848-4428-b648-c2d284629fe8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:44.178647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:44.179420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:44.179697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:44.179965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] PATH_INFO: `/v3/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:44.181921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] RBAC: Authorizing `identity:get_role(role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:44.183314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:44.184667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 555/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:44 2022] GET /identity/v3/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:44.190733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614e332-9291-4278-850c-0662d4836c9d None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:44.285499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614e332-9291-4278-850c-0662d4836c9d None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:44.318610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:44.319468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:44.319759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:44.320035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] PATH_INFO: `/v3/users/017a46a5bec5420b9a5c945ccc024acc` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:44.321201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] RBAC: Authorizing `identity:get_user(user_id=017a46a5bec5420b9a5c945ccc024acc)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:44.323271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:44.324877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 566/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:44 2022] GET /identity/v3/users/017a46a5bec5420b9a5c945ccc024acc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:44.330591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:44.423616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:44.429769 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31952a4-64a9-4a46-b5b8-ec90b0606838 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:44.463910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c8b1e-5d92-4500-a731-a1187ecf2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:44.464751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c8b1e-5d92-4500-a731-a1187ecf2344 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:44.465029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c8b1e-5d92-4500-a731-a1187ecf2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:44.465299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c8b1e-5d92-4500-a731-a1187ecf2344 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:44.466662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c8b1e-5d92-4500-a731-a1187ecf2344 None admin] RBAC: Authorizing `identity:get_project(project_id=0390720680ad4a07aeb4ef48e364ee9b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:44.468081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c8b1e-5d92-4500-a731-a1187ecf2344 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:44.469759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 556/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:44 2022] GET /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:44.475690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:44.500670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:44.573242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c2dc-8a1f-4df0-b7ec-6a5fe578573b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:44.605764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7a32-8dc0-4b3c-9dda-a78fe5fc61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:44.606657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7a32-8dc0-4b3c-9dda-a78fe5fc61b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:44.606944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7a32-8dc0-4b3c-9dda-a78fe5fc61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:44.607223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7a32-8dc0-4b3c-9dda-a78fe5fc61b9 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b/users/017a46a5bec5420b9a5c945ccc024acc/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:44.609388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7a32-8dc0-4b3c-9dda-a78fe5fc61b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0390720680ad4a07aeb4ef48e364ee9b, user_id=017a46a5bec5420b9a5c945ccc024acc, role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:44.610851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7a32-8dc0-4b3c-9dda-a78fe5fc61b9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:44.680650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 567/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:26:44 2022] PUT /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b/users/017a46a5bec5420b9a5c945ccc024acc/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:26:46.841727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb27b2-ce04-42a5-89ad-c06c77a2d25c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:46.842326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb27b2-ce04-42a5-89ad-c06c77a2d25c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:46.842326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb27b2-ce04-42a5-89ad-c06c77a2d25c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:46.843717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 557/1124] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:46.848812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403622d-6b13-4d3c-974b-bcf422e2882a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:46.849224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403622d-6b13-4d3c-974b-bcf422e2882a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:46.849377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403622d-6b13-4d3c-974b-bcf422e2882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:46.865664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c403622d-6b13-4d3c-974b-bcf422e2882a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:46.866870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c403622d-6b13-4d3c-974b-bcf422e2882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:46.931132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 568/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:46.954543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb27b2-ce04-42a5-89ad-c06c77a2d25c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:47.053255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb27b2-ce04-42a5-89ad-c06c77a2d25c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:47.086147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:47.087109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:47.087399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:47.088240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] PATH_INFO: `/v3/roles/270ce9f3844b4c68b4d2862519de91a8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:47.089691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] RBAC: Authorizing `identity:get_role(role_id=270ce9f3844b4c68b4d2862519de91a8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:47.091085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:47.092479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 558/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:46 2022] GET /identity/v3/roles/270ce9f3844b4c68b4d2862519de91a8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:47.098009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403622d-6b13-4d3c-974b-bcf422e2882a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:47.112317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:47.192110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403622d-6b13-4d3c-974b-bcf422e2882a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:47.225004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:47.225853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:47.226132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:47.226431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] PATH_INFO: `/v3/users/017a46a5bec5420b9a5c945ccc024acc` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:47.227587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] RBAC: Authorizing `identity:get_user(user_id=017a46a5bec5420b9a5c945ccc024acc)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:47.229042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:47.230666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 569/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:47 2022] GET /identity/v3/users/017a46a5bec5420b9a5c945ccc024acc => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:47.236250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:47.271873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:47.345324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27809fd-0eca-4346-9e9f-a9ba3eb692dd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:47.378619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:47.379257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:47.379543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:47.379822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:47.444561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:47.446000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:47.473970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:47.543269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 559/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:26:47.549215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:47.627754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:47.644605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec4225-59ce-42f2-8aa0-ac06da829437 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:47.677368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c532e9-160b-4c5c-a25b-e539c1577216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:47.678231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c532e9-160b-4c5c-a25b-e539c1577216 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:47.678516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c532e9-160b-4c5c-a25b-e539c1577216 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:47.678792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c532e9-160b-4c5c-a25b-e539c1577216 None admin] PATH_INFO: `/v3/projects/0390720680ad4a07aeb4ef48e364ee9b` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:47.679961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c532e9-160b-4c5c-a25b-e539c1577216 None admin] RBAC: Authorizing `identity:get_project(project_id=0390720680ad4a07aeb4ef48e364ee9b)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:47.682002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c532e9-160b-4c5c-a25b-e539c1577216 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:47.683685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 570/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:47 2022] GET /identity/v3/projects/0390720680ad4a07aeb4ef48e364ee9b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:47.689836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:47.784342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c47738-6afd-46ed-a8c1-c170539eecc2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:47.813324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:47.818870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb2df-d613-457e-9a3a-69351ac2da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:47.819507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb2df-d613-457e-9a3a-69351ac2da4f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:47.819789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb2df-d613-457e-9a3a-69351ac2da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:47.820060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb2df-d613-457e-9a3a-69351ac2da4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:47.820867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb2df-d613-457e-9a3a-69351ac2da4f None admin] RBAC: Adding query filter params (role.id=270ce9f3844b4c68b4d2862519de91a8, scope.project.id=0390720680ad4a07aeb4ef48e364ee9b, user.id=017a46a5bec5420b9a5c945ccc024acc) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:47.821178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb2df-d613-457e-9a3a-69351ac2da4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:47.822672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb2df-d613-457e-9a3a-69351ac2da4f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:47.828226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 560/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:47 2022] GET /identity/v3/role_assignments?user.id=017a46a5bec5420b9a5c945ccc024acc&scope.project.id=0390720680ad4a07aeb4ef48e364ee9b&role.id=270ce9f3844b4c68b4d2862519de91a8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:50.057578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825ccd-a69e-405b-ba2a-a0a81434f3d6 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:50.058107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825ccd-a69e-405b-ba2a-a0a81434f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:50.058107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825ccd-a69e-405b-ba2a-a0a81434f3d6 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:50.059505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 571/1131] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:50.064954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dea98-0f7e-4398-a534-2d4bd2d723f1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:50.065360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dea98-0f7e-4398-a534-2d4bd2d723f1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:50.065510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dea98-0f7e-4398-a534-2d4bd2d723f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:50.082193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e71dea98-0f7e-4398-a534-2d4bd2d723f1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:50.083366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e71dea98-0f7e-4398-a534-2d4bd2d723f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:50.153045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 561/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:50.175691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825ccd-a69e-405b-ba2a-a0a81434f3d6 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:50.274428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825ccd-a69e-405b-ba2a-a0a81434f3d6 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:50.307558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e174fe3-cf51-43d8-88cb-d8e417abae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:50.308386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174fe3-cf51-43d8-88cb-d8e417abae81 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:50.308627 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174fe3-cf51-43d8-88cb-d8e417abae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:50.308903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174fe3-cf51-43d8-88cb-d8e417abae81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:50.310059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e174fe3-cf51-43d8-88cb-d8e417abae81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:50.311800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e174fe3-cf51-43d8-88cb-d8e417abae81 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:50.313399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 572/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:50.319207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dea98-0f7e-4398-a534-2d4bd2d723f1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:50.413365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dea98-0f7e-4398-a534-2d4bd2d723f1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:50.435962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:50.446277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303c9d2-df5e-4c75-acf7-da9eaa5ba48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:50.446947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303c9d2-df5e-4c75-acf7-da9eaa5ba48b None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:50.447225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303c9d2-df5e-4c75-acf7-da9eaa5ba48b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:50.447497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303c9d2-df5e-4c75-acf7-da9eaa5ba48b None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:50.448195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303c9d2-df5e-4c75-acf7-da9eaa5ba48b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:50.449611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303c9d2-df5e-4c75-acf7-da9eaa5ba48b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:50.578304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 562/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:26:50 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:52.824914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cfcf-b39e-4b03-b458-6a697edf7180 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:52.825461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cfcf-b39e-4b03-b458-6a697edf7180 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:52.825461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cfcf-b39e-4b03-b458-6a697edf7180 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:52.826865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 573/1135] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:52.831979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240f9d-4d83-4658-80a3-314357b87e1b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:52.832391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240f9d-4d83-4658-80a3-314357b87e1b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:52.832545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240f9d-4d83-4658-80a3-314357b87e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:52.848887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2e240f9d-4d83-4658-80a3-314357b87e1b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:52.850070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2e240f9d-4d83-4658-80a3-314357b87e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:52.914326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 563/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:52.939951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93cfcf-b39e-4b03-b458-6a697edf7180 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:52.958259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:53.037950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93cfcf-b39e-4b03-b458-6a697edf7180 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:53.071279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b443-bb61-440c-a9e2-44a8dd6409ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:53.072591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b443-bb61-440c-a9e2-44a8dd6409ae None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:53.072868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b443-bb61-440c-a9e2-44a8dd6409ae None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:53.073138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b443-bb61-440c-a9e2-44a8dd6409ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:53.074314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b443-bb61-440c-a9e2-44a8dd6409ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:53.075791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b443-bb61-440c-a9e2-44a8dd6409ae None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:53.077304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 574/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:53.082897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240f9d-4d83-4658-80a3-314357b87e1b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:53.178886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240f9d-4d83-4658-80a3-314357b87e1b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:53.186646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:53.212073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee26400-0e07-428c-9c71-8d9cedd0e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:53.212781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26400-0e07-428c-9c71-8d9cedd0e6e2 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:53.213060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26400-0e07-428c-9c71-8d9cedd0e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:53.213334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26400-0e07-428c-9c71-8d9cedd0e6e2 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:53.214043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee26400-0e07-428c-9c71-8d9cedd0e6e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:53.215491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee26400-0e07-428c-9c71-8d9cedd0e6e2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:53.344783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 564/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:26:53 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:26:55.598719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8db43-8356-4ea3-a5aa-c7d65e82525a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:55.599238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8db43-8356-4ea3-a5aa-c7d65e82525a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:55.599238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8db43-8356-4ea3-a5aa-c7d65e82525a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:55.600531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 575/1139] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:55.606859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381dabc-c9c6-4316-a981-f7e89e0ea741 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:55.607300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381dabc-c9c6-4316-a981-f7e89e0ea741 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:55.607390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381dabc-c9c6-4316-a981-f7e89e0ea741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:55.624199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7381dabc-c9c6-4316-a981-f7e89e0ea741 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:55.625355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7381dabc-c9c6-4316-a981-f7e89e0ea741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:55.689112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 565/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:26:55.712968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8db43-8356-4ea3-a5aa-c7d65e82525a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:55.794884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:55.809724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8db43-8356-4ea3-a5aa-c7d65e82525a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:55.842459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:55.843231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:55.843509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:55.843782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:55.853985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:55.861436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:55.862583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:55.863461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 576/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:55.869105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381dabc-c9c6-4316-a981-f7e89e0ea741 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:55.955115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:55.964638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381dabc-c9c6-4316-a981-f7e89e0ea741 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:56.001308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:56.001981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:56.007178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:56.007178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:56.007178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:56.007178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:56.007178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:56.013566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 566/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:56.019145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:56.121453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a9d9f-a4fc-4929-a997-307354412461 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:56.155386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:56.156272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:56.162048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:56.162048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] PATH_INFO: `/v3/users/f8bd66cb3f5943e3b84f1ced672000f5` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:56.171048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bd66cb3f5943e3b84f1ced672000f5)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:56.172444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:56.174104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 577/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:56 2022] GET /identity/v3/users/f8bd66cb3f5943e3b84f1ced672000f5 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:56.179838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:56.280690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167083d-63e5-4d66-b46c-1180d8dcf8dc None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:56.314006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:56.314687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:56.314975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:56.315252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:56.338660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:56.381092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:56.382791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:56.479684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 567/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:26:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:26:56.485563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:56.489288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:56.582007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a83407-cc2e-41b8-868d-7498204e38f7 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:56.614595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848eaee-ec82-4330-a979-0fbb5efc471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:56.615433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848eaee-ec82-4330-a979-0fbb5efc471f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:56.615718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848eaee-ec82-4330-a979-0fbb5efc471f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:56.615995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848eaee-ec82-4330-a979-0fbb5efc471f None admin] PATH_INFO: `/v3/projects/57864e39c4bc43b8a2006845838d1be8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:56.617152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848eaee-ec82-4330-a979-0fbb5efc471f None admin] RBAC: Authorizing `identity:get_project(project_id=57864e39c4bc43b8a2006845838d1be8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:56.619216 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848eaee-ec82-4330-a979-0fbb5efc471f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:56.620952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 578/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:56 2022] GET /identity/v3/projects/57864e39c4bc43b8a2006845838d1be8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:56.627168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:56.679938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:56.722897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a0fe1-3694-40c3-bde3-ece53afc1238 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:56.756239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388c351-26e4-4d7c-bb74-42aefb47522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:56.756877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388c351-26e4-4d7c-bb74-42aefb47522c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:56.757159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388c351-26e4-4d7c-bb74-42aefb47522c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:56.757432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388c351-26e4-4d7c-bb74-42aefb47522c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:56.758268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388c351-26e4-4d7c-bb74-42aefb47522c None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=57864e39c4bc43b8a2006845838d1be8, user.id=f8bd66cb3f5943e3b84f1ced672000f5) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:56.758578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388c351-26e4-4d7c-bb74-42aefb47522c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:56.760043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388c351-26e4-4d7c-bb74-42aefb47522c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:56.765306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 568/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:26:56 2022] GET /identity/v3/role_assignments?user.id=f8bd66cb3f5943e3b84f1ced672000f5&scope.project.id=57864e39c4bc43b8a2006845838d1be8&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:58.948701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cb1f-5c6f-4c72-b35a-b180f673511b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:58.949224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cb1f-5c6f-4c72-b35a-b180f673511b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:58.949318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cb1f-5c6f-4c72-b35a-b180f673511b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:58.950643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 579/1147] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:26:58.955968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa312-de5b-48d4-9568-70046e44d566 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:58.956375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa312-de5b-48d4-9568-70046e44d566 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:58.956531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa312-de5b-48d4-9568-70046e44d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:58.972993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-da4aa312-de5b-48d4-9568-70046e44d566 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:26:58.974158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-da4aa312-de5b-48d4-9568-70046e44d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:26:59.038923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 569/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:26:59.061707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056cb1f-5c6f-4c72-b35a-b180f673511b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:59.130475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:59.167996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056cb1f-5c6f-4c72-b35a-b180f673511b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:59.202120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:59.202862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:59.203150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:59.203430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:59.213850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:26:59.221382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:26:59.222465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:26:59.223413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 580/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:26:59.229150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa312-de5b-48d4-9568-70046e44d566 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:59.275701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:59.325906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa312-de5b-48d4-9568-70046e44d566 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:59.359754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:59.360415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:59.360697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:59.360994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:59.361750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:26:59.362072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:59.363475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:59.374712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 570/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:59.380654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:59.481975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984035bd-c383-41f1-a5e7-1ded21c04732 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:59.529712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:59.535024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:59.535888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:59.536303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:59.536719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] PATH_INFO: `/v3/users/f8bd66cb3f5943e3b84f1ced672000f5` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:59.538016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bd66cb3f5943e3b84f1ced672000f5)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:59.539480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:59.541657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 581/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:26:59 2022] GET /identity/v3/users/f8bd66cb3f5943e3b84f1ced672000f5 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:59.547460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:59.644895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799a80-ceb0-4e9c-b714-0eb9bf527d22 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:59.654839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:59.678001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840742aa-2e9c-4a0a-b2cf-c46c820e44b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:59.678895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840742aa-2e9c-4a0a-b2cf-c46c820e44b7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:59.679181 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840742aa-2e9c-4a0a-b2cf-c46c820e44b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:59.679456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840742aa-2e9c-4a0a-b2cf-c46c820e44b7 None admin] PATH_INFO: `/v3/projects/57864e39c4bc43b8a2006845838d1be8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:59.681219 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840742aa-2e9c-4a0a-b2cf-c46c820e44b7 None admin] RBAC: Authorizing `identity:get_project(project_id=57864e39c4bc43b8a2006845838d1be8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:59.682767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840742aa-2e9c-4a0a-b2cf-c46c820e44b7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:59.684853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 571/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:26:59 2022] GET /identity/v3/projects/57864e39c4bc43b8a2006845838d1be8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:26:59.690797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:26:59.786672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d8c09-d64b-41e5-87c8-1b890d05dbe4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:26:59.820200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330fac2-527f-4724-a2b1-2b9d327e01a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:26:59.821086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330fac2-527f-4724-a2b1-2b9d327e01a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:26:59.821399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330fac2-527f-4724-a2b1-2b9d327e01a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:26:59.821681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330fac2-527f-4724-a2b1-2b9d327e01a0 None admin] PATH_INFO: `/v3/projects/57864e39c4bc43b8a2006845838d1be8/users/f8bd66cb3f5943e3b84f1ced672000f5/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:26:59.823655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330fac2-527f-4724-a2b1-2b9d327e01a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=57864e39c4bc43b8a2006845838d1be8, user_id=f8bd66cb3f5943e3b84f1ced672000f5, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:26:59.825117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330fac2-527f-4724-a2b1-2b9d327e01a0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:26:59.921463 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 582/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:26:59 2022] PUT /identity/v3/projects/57864e39c4bc43b8a2006845838d1be8/users/f8bd66cb3f5943e3b84f1ced672000f5/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:27:02.075787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aa0ce-eec5-4aaa-85d5-4dd73e39b3cf None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:02.076379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aa0ce-eec5-4aaa-85d5-4dd73e39b3cf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:02.076379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aa0ce-eec5-4aaa-85d5-4dd73e39b3cf None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:02.077719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 572/1154] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:02.083001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80f6a-8ca7-47b2-866b-5d7922c53533 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:02.083396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80f6a-8ca7-47b2-866b-5d7922c53533 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:02.083567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80f6a-8ca7-47b2-866b-5d7922c53533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:02.099922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fed80f6a-8ca7-47b2-866b-5d7922c53533 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:02.101101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fed80f6a-8ca7-47b2-866b-5d7922c53533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:02.156774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:02.168363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 583/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:27:02.191712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9aa0ce-eec5-4aaa-85d5-4dd73e39b3cf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:02.293344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9aa0ce-eec5-4aaa-85d5-4dd73e39b3cf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:02.327427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:02.328157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:02.328443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:02.328717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:02.338990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:27:02.346552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:27:02.347694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:27:02.348782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 573/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:27:02.353694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed80f6a-8ca7-47b2-866b-5d7922c53533 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:02.451605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed80f6a-8ca7-47b2-866b-5d7922c53533 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:02.485508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:02.486164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:02.486500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:02.486778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:02.487509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:02.487817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:02.489184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:02.497007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 584/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:02.502812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:02.542022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:02.600235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75895e-fb07-41b5-9fb9-4ef46ba75a0c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:02.632455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:02.633302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:02.634964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:02.634964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] PATH_INFO: `/v3/users/f8bd66cb3f5943e3b84f1ced672000f5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:02.635558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bd66cb3f5943e3b84f1ced672000f5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:02.636982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:02.638641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 574/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:27:02 2022] GET /identity/v3/users/f8bd66cb3f5943e3b84f1ced672000f5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:02.644264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:02.695053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:02.741439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2b87c-2dc9-47a3-8f08-0424217c391b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:02.774811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:02.775451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:02.775755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:02.776036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:02.840162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:02.841602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:02.891467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:02.936883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 585/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:27:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:27:02.942830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:03.038170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698a432-cd71-43f1-8b7a-47c2c2e89802 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:03.045152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:03.071821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45abb22-2333-422b-aadd-bb3c327294e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:03.072663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45abb22-2333-422b-aadd-bb3c327294e0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:03.072944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45abb22-2333-422b-aadd-bb3c327294e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:03.073220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45abb22-2333-422b-aadd-bb3c327294e0 None admin] PATH_INFO: `/v3/projects/57864e39c4bc43b8a2006845838d1be8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:03.074656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45abb22-2333-422b-aadd-bb3c327294e0 None admin] RBAC: Authorizing `identity:get_project(project_id=57864e39c4bc43b8a2006845838d1be8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:03.076361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45abb22-2333-422b-aadd-bb3c327294e0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:03.078346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 575/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:27:02 2022] GET /identity/v3/projects/57864e39c4bc43b8a2006845838d1be8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:03.084437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:03.180113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b98a5-459d-4565-a332-ac1daf85a23e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:03.213508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e829c17-edaf-47b3-a104-4d43fb9abbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:03.214145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829c17-edaf-47b3-a104-4d43fb9abbfc None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:03.214462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829c17-edaf-47b3-a104-4d43fb9abbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:03.214744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829c17-edaf-47b3-a104-4d43fb9abbfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:03.215560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e829c17-edaf-47b3-a104-4d43fb9abbfc None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=57864e39c4bc43b8a2006845838d1be8, user.id=f8bd66cb3f5943e3b84f1ced672000f5) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:03.215878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e829c17-edaf-47b3-a104-4d43fb9abbfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:03.217304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e829c17-edaf-47b3-a104-4d43fb9abbfc None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:03.222975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 586/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:27:03 2022] GET /identity/v3/role_assignments?user.id=f8bd66cb3f5943e3b84f1ced672000f5&scope.project.id=57864e39c4bc43b8a2006845838d1be8&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:05.442583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fee1-2a02-49a5-98e9-8d515d0238c4 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:05.443129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fee1-2a02-49a5-98e9-8d515d0238c4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:05.443129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fee1-2a02-49a5-98e9-8d515d0238c4 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:05.444517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 576/1162] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:05.450554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0bb2-dc33-4eca-948e-b22c0fd9a82b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:05.450961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0bb2-dc33-4eca-948e-b22c0fd9a82b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:05.451103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0bb2-dc33-4eca-948e-b22c0fd9a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:05.467444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-437d0bb2-dc33-4eca-948e-b22c0fd9a82b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:05.468615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-437d0bb2-dc33-4eca-948e-b22c0fd9a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:05.478900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:05.533114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 587/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:27:05.556682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fee1-2a02-49a5-98e9-8d515d0238c4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:05.664207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fee1-2a02-49a5-98e9-8d515d0238c4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:05.698011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:05.698678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:05.698968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:05.699245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:05.739616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:05.765477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:05.766973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:05.863237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 577/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:27:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:27:05.869791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0bb2-dc33-4eca-948e-b22c0fd9a82b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:05.971312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0bb2-dc33-4eca-948e-b22c0fd9a82b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:06.004400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e57a2-4d32-4372-8ccd-a2359d10ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:06.005196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e57a2-4d32-4372-8ccd-a2359d10ea12 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:06.005484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e57a2-4d32-4372-8ccd-a2359d10ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:06.005760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e57a2-4d32-4372-8ccd-a2359d10ea12 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:06.012270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e57a2-4d32-4372-8ccd-a2359d10ea12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:06.013726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e57a2-4d32-4372-8ccd-a2359d10ea12 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-a36e57a2-4d32-4372-8ccd-a2359d10ea12 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:27:06.027985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:27:06.029185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:27:06.030248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 588/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:27:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:27:06.035151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:06.106128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:06.129435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa5476-e506-4f53-83c5-ab5ec6747dac None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:06.162664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642aa3-8852-4abb-bda7-40a7c9a16560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:06.163308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642aa3-8852-4abb-bda7-40a7c9a16560 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:06.163592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642aa3-8852-4abb-bda7-40a7c9a16560 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:06.163867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642aa3-8852-4abb-bda7-40a7c9a16560 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:06.164589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d642aa3-8852-4abb-bda7-40a7c9a16560 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:06.165484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d642aa3-8852-4abb-bda7-40a7c9a16560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:06.166874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d642aa3-8852-4abb-bda7-40a7c9a16560 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:06.173798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 578/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 19 21:27:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:08.373842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c589-d05d-486d-a540-90f6729f21a6 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:08.374373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c589-d05d-486d-a540-90f6729f21a6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:08.374478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c589-d05d-486d-a540-90f6729f21a6 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:08.375755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 589/1167] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:08.381024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ae3d-11ec-4786-866e-256c401b8226 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:08.381445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ae3d-11ec-4786-866e-256c401b8226 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:08.381581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ae3d-11ec-4786-866e-256c401b8226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:08.398483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5311ae3d-11ec-4786-866e-256c401b8226 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:08.399676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5311ae3d-11ec-4786-866e-256c401b8226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:08.464513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 579/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:27:08.487285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c589-d05d-486d-a540-90f6729f21a6 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:08.497261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:08.588190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c589-d05d-486d-a540-90f6729f21a6 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:08.619908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da77a6-64d7-4fe5-a7a0-64dbb60e1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:08.620549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da77a6-64d7-4fe5-a7a0-64dbb60e1563 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:08.620833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da77a6-64d7-4fe5-a7a0-64dbb60e1563 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:08.621109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da77a6-64d7-4fe5-a7a0-64dbb60e1563 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:08.621842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da77a6-64d7-4fe5-a7a0-64dbb60e1563 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:08.623241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da77a6-64d7-4fe5-a7a0-64dbb60e1563 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:08.690479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 590/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Thu May 19 21:27:08 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:27:10.915353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715c86-e7b1-4d78-be90-123b5c79b0b6 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:10.915877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715c86-e7b1-4d78-be90-123b5c79b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:10.915985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715c86-e7b1-4d78-be90-123b5c79b0b6 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:10.917288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 580/1170] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:10.922776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55550ce6-bd73-476a-9b7d-039e2158acc3 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:10.923197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55550ce6-bd73-476a-9b7d-039e2158acc3 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:10.923321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55550ce6-bd73-476a-9b7d-039e2158acc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:10.940359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-55550ce6-bd73-476a-9b7d-039e2158acc3 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:10.941510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-55550ce6-bd73-476a-9b7d-039e2158acc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:10.997999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:11.005039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 591/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:27:11.027669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48715c86-e7b1-4d78-be90-123b5c79b0b6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:11.093388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:11.126972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48715c86-e7b1-4d78-be90-123b5c79b0b6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:11.159673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdcf08-7e29-400c-a4af-2c0485fd3688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:11.160514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdcf08-7e29-400c-a4af-2c0485fd3688 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:11.160795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdcf08-7e29-400c-a4af-2c0485fd3688 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:11.161069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdcf08-7e29-400c-a4af-2c0485fd3688 None admin] PATH_INFO: `/v3/domains/4feb70e835ab44b09625d44209d79d3c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:11.171778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdcf08-7e29-400c-a4af-2c0485fd3688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4feb70e835ab44b09625d44209d79d3c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:11.173164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdcf08-7e29-400c-a4af-2c0485fd3688 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:11.174800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 581/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Thu May 19 21:27:11 2022] GET /identity/v3/domains/4feb70e835ab44b09625d44209d79d3c => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:11.180683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55550ce6-bd73-476a-9b7d-039e2158acc3 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:11.275454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55550ce6-bd73-476a-9b7d-039e2158acc3 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:11.308543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59b924-d25c-4147-813b-cc432db988c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:11.309196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59b924-d25c-4147-813b-cc432db988c6 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:11.309479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59b924-d25c-4147-813b-cc432db988c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:11.309753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59b924-d25c-4147-813b-cc432db988c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:11.310746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59b924-d25c-4147-813b-cc432db988c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:11.312173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59b924-d25c-4147-813b-cc432db988c6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:11.398327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 592/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:27:11 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:27:13.638104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e210d-0878-46e8-94b9-9eb1b1df1c45 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:13.638645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e210d-0878-46e8-94b9-9eb1b1df1c45 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:13.638760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e210d-0878-46e8-94b9-9eb1b1df1c45 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:13.640047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 582/1174] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:13.645361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7a08-4b15-4845-b873-4ed16742c109 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:13.645751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7a08-4b15-4845-b873-4ed16742c109 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:13.645930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7a08-4b15-4845-b873-4ed16742c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:13.662817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4fef7a08-4b15-4845-b873-4ed16742c109 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:13.663991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4fef7a08-4b15-4845-b873-4ed16742c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:13.705644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:13.728982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 593/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:27:13.753015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e210d-0878-46e8-94b9-9eb1b1df1c45 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:13.851035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e210d-0878-46e8-94b9-9eb1b1df1c45 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:13.875432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:13.882797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a23904-b767-4ffb-b4dc-fce59b5aca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:13.888826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a23904-b767-4ffb-b4dc-fce59b5aca26 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:13.888826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a23904-b767-4ffb-b4dc-fce59b5aca26 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:13.888826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a23904-b767-4ffb-b4dc-fce59b5aca26 None admin] PATH_INFO: `/v3/domains/4feb70e835ab44b09625d44209d79d3c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:13.888826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a23904-b767-4ffb-b4dc-fce59b5aca26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4feb70e835ab44b09625d44209d79d3c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:13.888826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a23904-b767-4ffb-b4dc-fce59b5aca26 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:13.889632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 583/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Thu May 19 21:27:13 2022] GET /identity/v3/domains/4feb70e835ab44b09625d44209d79d3c => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:13.895470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7a08-4b15-4845-b873-4ed16742c109 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:13.991387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7a08-4b15-4845-b873-4ed16742c109 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:14.024441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e929d4-3e84-4eb2-946e-773405c132f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:14.025095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e929d4-3e84-4eb2-946e-773405c132f1 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:14.025380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e929d4-3e84-4eb2-946e-773405c132f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:14.025653 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e929d4-3e84-4eb2-946e-773405c132f1 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:14.026373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e929d4-3e84-4eb2-946e-773405c132f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:14.027801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e929d4-3e84-4eb2-946e-773405c132f1 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:14.094407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 594/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:27:13 2022] POST /identity/v3/users => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:27:16.389108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20c03-0285-4260-a843-eaa72e437ced None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:16.389622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20c03-0285-4260-a843-eaa72e437ced None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:16.389739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20c03-0285-4260-a843-eaa72e437ced None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:16.391100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 584/1178] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:16.396152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319559-97b2-493c-8605-4c9ebcecb325 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:16.396544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319559-97b2-493c-8605-4c9ebcecb325 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:16.396706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319559-97b2-493c-8605-4c9ebcecb325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:16.413381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-32319559-97b2-493c-8605-4c9ebcecb325 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:16.415161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-32319559-97b2-493c-8605-4c9ebcecb325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:16.440442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:16.479159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 595/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:27:16.501606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20c03-0285-4260-a843-eaa72e437ced None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:16.601302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20c03-0285-4260-a843-eaa72e437ced None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:16.634080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:16.634881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:16.635168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:16.635444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:16.646515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:27:16.654636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:27:16.655699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:27:16.656729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 585/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:27:16.661620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319559-97b2-493c-8605-4c9ebcecb325 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:16.757102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319559-97b2-493c-8605-4c9ebcecb325 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:16.790143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:16.790828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:16.791114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:16.791386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:16.792120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:16.792427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:16.793796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:16.801543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 596/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:16.807264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:16.862054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:16.904376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff789f-aa36-4111-af8f-f8260354496e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:16.937168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:16.938020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:16.938330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:16.938614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] PATH_INFO: `/v3/users/001c9c6d5de746f197fd0a9c047eedb6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:16.951889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] RBAC: Authorizing `identity:get_user(user_id=001c9c6d5de746f197fd0a9c047eedb6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:16.953335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:16.955010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 586/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:27:16 2022] GET /identity/v3/users/001c9c6d5de746f197fd0a9c047eedb6 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:16.960825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:16.988082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:17.057475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee5cb-ad42-4fe3-9b2f-6ca55581c7e8 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:17.090402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:17.091036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:17.091320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:17.091595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:17.154897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:17.156335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:17.180951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:17.250283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 597/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:27:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:27:17.256214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:17.351677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb819ca-bc0e-4e0e-be4e-d9eff086adc8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:17.364843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:17.384612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a1fc4-3ebe-40e9-8fe1-436becf2f6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:17.385460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a1fc4-3ebe-40e9-8fe1-436becf2f6ed None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:17.385743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a1fc4-3ebe-40e9-8fe1-436becf2f6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:17.386014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a1fc4-3ebe-40e9-8fe1-436becf2f6ed None admin] PATH_INFO: `/v3/projects/c300dbaf20f9484cbffbc05e5012b463` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:17.387186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a1fc4-3ebe-40e9-8fe1-436becf2f6ed None admin] RBAC: Authorizing `identity:get_project(project_id=c300dbaf20f9484cbffbc05e5012b463)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:17.388603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a1fc4-3ebe-40e9-8fe1-436becf2f6ed None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:17.390281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 587/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:27:17 2022] GET /identity/v3/projects/c300dbaf20f9484cbffbc05e5012b463 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:17.396501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:17.491650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549cc8-3649-4a3f-b399-50a3330eb00b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:17.518636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:17.531871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343225a-5813-44ac-98ca-b3f1a73b0377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:17.534370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343225a-5813-44ac-98ca-b3f1a73b0377 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:17.534370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343225a-5813-44ac-98ca-b3f1a73b0377 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:17.534370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343225a-5813-44ac-98ca-b3f1a73b0377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:17.534370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343225a-5813-44ac-98ca-b3f1a73b0377 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=c300dbaf20f9484cbffbc05e5012b463, user.id=001c9c6d5de746f197fd0a9c047eedb6) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:17.534792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343225a-5813-44ac-98ca-b3f1a73b0377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:17.535859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343225a-5813-44ac-98ca-b3f1a73b0377 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:17.541806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 598/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:27:17 2022] GET /identity/v3/role_assignments?user.id=001c9c6d5de746f197fd0a9c047eedb6&scope.project.id=c300dbaf20f9484cbffbc05e5012b463&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:27:19.725028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf5f1-ee8a-4fd9-97b0-21a6ed457702 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:19.725584 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf5f1-ee8a-4fd9-97b0-21a6ed457702 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:19.725584 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf5f1-ee8a-4fd9-97b0-21a6ed457702 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:19.727640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 588/1186] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:19.732986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ac9e0-0e9f-422b-9c55-4ca2faebbeaf None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:19.733396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ac9e0-0e9f-422b-9c55-4ca2faebbeaf None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:19.733548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ac9e0-0e9f-422b-9c55-4ca2faebbeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:19.749780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-cd6ac9e0-0e9f-422b-9c55-4ca2faebbeaf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:19.750990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cd6ac9e0-0e9f-422b-9c55-4ca2faebbeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:19.815253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 599/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:27:19.838591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddf5f1-ee8a-4fd9-97b0-21a6ed457702 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:19.936569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddf5f1-ee8a-4fd9-97b0-21a6ed457702 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:19.969880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:19.970673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:19.970958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:19.971234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:19.981601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:27:19.989100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:27:19.990166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:27:19.991217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 589/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:27:19.996370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ac9e0-0e9f-422b-9c55-4ca2faebbeaf None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:20.091807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ac9e0-0e9f-422b-9c55-4ca2faebbeaf None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:20.111408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:20.125246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:20.125904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:20.126271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:20.126555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:20.127290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:20.127600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:20.128978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:20.137426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 600/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:20.143159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:20.186168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:20.240460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1942a-1ba7-4441-944e-fc6d5f51b774 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:20.273117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:20.274007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:20.274317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:20.274601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] PATH_INFO: `/v3/users/001c9c6d5de746f197fd0a9c047eedb6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:20.275764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] RBAC: Authorizing `identity:get_user(user_id=001c9c6d5de746f197fd0a9c047eedb6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:20.277196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:20.278853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 590/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:27:20 2022] GET /identity/v3/users/001c9c6d5de746f197fd0a9c047eedb6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:20.284487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:20.381852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636bc4-fae2-4e28-9bfd-ad44baf6ce7d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:20.415097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20338b9a-d0c0-4793-9050-18776336c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:20.415932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338b9a-d0c0-4793-9050-18776336c82a None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:20.416212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338b9a-d0c0-4793-9050-18776336c82a None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:20.416483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338b9a-d0c0-4793-9050-18776336c82a None admin] PATH_INFO: `/v3/projects/c300dbaf20f9484cbffbc05e5012b463` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:20.417639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20338b9a-d0c0-4793-9050-18776336c82a None admin] RBAC: Authorizing `identity:get_project(project_id=c300dbaf20f9484cbffbc05e5012b463)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:20.419087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20338b9a-d0c0-4793-9050-18776336c82a None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:20.420739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 601/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:27:20 2022] GET /identity/v3/projects/c300dbaf20f9484cbffbc05e5012b463 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:20.426580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:20.523042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b771-6b2e-40f9-9ad8-f4f35bb1feb4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:20.533449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:20.555898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea983a8-0037-4cf8-8889-31a1ba5f282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:20.556763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea983a8-0037-4cf8-8889-31a1ba5f282a None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:20.557044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea983a8-0037-4cf8-8889-31a1ba5f282a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:20.557316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea983a8-0037-4cf8-8889-31a1ba5f282a None admin] PATH_INFO: `/v3/projects/c300dbaf20f9484cbffbc05e5012b463/users/001c9c6d5de746f197fd0a9c047eedb6/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:20.559285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea983a8-0037-4cf8-8889-31a1ba5f282a None admin] RBAC: Authorizing `identity:create_grant(project_id=c300dbaf20f9484cbffbc05e5012b463, user_id=001c9c6d5de746f197fd0a9c047eedb6, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:20.561046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea983a8-0037-4cf8-8889-31a1ba5f282a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:20.648225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 591/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:27:20 2022] PUT /identity/v3/projects/c300dbaf20f9484cbffbc05e5012b463/users/001c9c6d5de746f197fd0a9c047eedb6/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:27:22.855412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8dba6-c94f-4eda-b458-2e64df028780 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:22.855936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8dba6-c94f-4eda-b458-2e64df028780 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:22.855936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8dba6-c94f-4eda-b458-2e64df028780 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:22.857360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 602/1193] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:27:22.862538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227bb4e-c49d-40ac-8977-6091b15a7f3f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:22.862944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227bb4e-c49d-40ac-8977-6091b15a7f3f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:22.863099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227bb4e-c49d-40ac-8977-6091b15a7f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:22.880018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b227bb4e-c49d-40ac-8977-6091b15a7f3f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:27:22.881195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b227bb4e-c49d-40ac-8977-6091b15a7f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:27:22.946126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 592/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:27:22.969689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8dba6-c94f-4eda-b458-2e64df028780 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:23.018486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:23.067480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8dba6-c94f-4eda-b458-2e64df028780 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:23.099705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:23.100477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:23.100763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:23.101041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:23.110829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:27:23.118827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:27:23.119886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:27:23.120750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 603/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:27:23.125884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227bb4e-c49d-40ac-8977-6091b15a7f3f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:23.219555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:23.222243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227bb4e-c49d-40ac-8977-6091b15a7f3f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:23.254694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:23.255347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:23.255682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:23.256152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:23.257050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:23.258265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:23.259732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:23.267539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 593/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:23.273226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:23.370767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c36d9-7c96-4eea-a07f-4a4302c829f7 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:23.380452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:23.403146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:23.403999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:23.404282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:23.404559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] PATH_INFO: `/v3/users/001c9c6d5de746f197fd0a9c047eedb6` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:23.405726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] RBAC: Authorizing `identity:get_user(user_id=001c9c6d5de746f197fd0a9c047eedb6)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:23.407187 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:23.408783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 604/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 19 21:27:23 2022] GET /identity/v3/users/001c9c6d5de746f197fd0a9c047eedb6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:23.414489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:23.511362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c466c22-a475-4d82-9822-492b091b623a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:23.548303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:23.549405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:23.549911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:23.550464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:23.585170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:23.621711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:23.623130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:23.716602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 594/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:27:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:27:23.722419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:23.817226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e2372-8193-40db-9eaf-a8c1ed1af2ff None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:23.848246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312208d1-84cd-49e3-a634-3678013d4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:23.849083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312208d1-84cd-49e3-a634-3678013d4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:23.849361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312208d1-84cd-49e3-a634-3678013d4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:23.849633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312208d1-84cd-49e3-a634-3678013d4ea0 None admin] PATH_INFO: `/v3/projects/c300dbaf20f9484cbffbc05e5012b463` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:23.850791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312208d1-84cd-49e3-a634-3678013d4ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=c300dbaf20f9484cbffbc05e5012b463)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:23.852728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312208d1-84cd-49e3-a634-3678013d4ea0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:23.854375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 605/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 19 21:27:23 2022] GET /identity/v3/projects/c300dbaf20f9484cbffbc05e5012b463 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:23.860288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:27:23.919005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:23.955317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b0d14-8e3d-4efa-8a84-848ba8029a26 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:27:23.988400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaffc4-6052-4cda-b701-c0a9ce57b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:27:23.989036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaffc4-6052-4cda-b701-c0a9ce57b491 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:27:23.989327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaffc4-6052-4cda-b701-c0a9ce57b491 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:27:23.989601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaffc4-6052-4cda-b701-c0a9ce57b491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:27:23.990444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaffc4-6052-4cda-b701-c0a9ce57b491 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=c300dbaf20f9484cbffbc05e5012b463, user.id=001c9c6d5de746f197fd0a9c047eedb6) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:27:23.990755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaffc4-6052-4cda-b701-c0a9ce57b491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:27:23.992210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaffc4-6052-4cda-b701-c0a9ce57b491 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:27:23.997821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 595/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:27:23 2022] GET /identity/v3/role_assignments?user.id=001c9c6d5de746f197fd0a9c047eedb6&scope.project.id=c300dbaf20f9484cbffbc05e5012b463&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:27:33.844277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=77 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:27:33.995282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=37 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:43.009323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78762dc-d21f-4dc8-b1e9-e879755c4b32 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:43.009904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78762dc-d21f-4dc8-b1e9-e879755c4b32 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:43.009904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78762dc-d21f-4dc8-b1e9-e879755c4b32 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:43.011255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 606/1201] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:28:43.016390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4310337-6d2b-43f2-969f-337e2a27bf6d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:43.016823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4310337-6d2b-43f2-969f-337e2a27bf6d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:43.016985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4310337-6d2b-43f2-969f-337e2a27bf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:43.033655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c4310337-6d2b-43f2-969f-337e2a27bf6d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:28:43.034937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c4310337-6d2b-43f2-969f-337e2a27bf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:28:43.102148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 596/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:28:43.127662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78762dc-d21f-4dc8-b1e9-e879755c4b32 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:43.227528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78762dc-d21f-4dc8-b1e9-e879755c4b32 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:43.269661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:43.269661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:43.269661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:43.269661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:43.272382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:43.273832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:43.291208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:43.292342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:43.293549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:43.293549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:43.293549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:43.293549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:43.293549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 607/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:43.298533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4310337-6d2b-43f2-969f-337e2a27bf6d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:43.395558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4310337-6d2b-43f2-969f-337e2a27bf6d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:43.424194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:43.429932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a848f62-bc1e-42d9-bf37-b39f3cede5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:43.430669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a848f62-bc1e-42d9-bf37-b39f3cede5ce None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:43.430955 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a848f62-bc1e-42d9-bf37-b39f3cede5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:43.431235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a848f62-bc1e-42d9-bf37-b39f3cede5ce None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:43.431946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a848f62-bc1e-42d9-bf37-b39f3cede5ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:43.432258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a848f62-bc1e-42d9-bf37-b39f3cede5ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:43.433899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a848f62-bc1e-42d9-bf37-b39f3cede5ce None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:43.444827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 597/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:43.450667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:43.503905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:43.550055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee799-65de-4ed9-b16d-054b10ebdea3 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:43.581696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ab048-f1dd-4bbd-bb9f-116f92c34333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:43.582388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ab048-f1dd-4bbd-bb9f-116f92c34333 None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:43.582769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ab048-f1dd-4bbd-bb9f-116f92c34333 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:43.587214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ab048-f1dd-4bbd-bb9f-116f92c34333 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:43.587214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ab048-f1dd-4bbd-bb9f-116f92c34333 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:43.587214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ab048-f1dd-4bbd-bb9f-116f92c34333 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:43.649922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 608/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 19 21:28:43 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:28:45.917560 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb0c2-9f26-4a3a-a3e2-f143b7f20a01 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:45.918116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb0c2-9f26-4a3a-a3e2-f143b7f20a01 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:45.918116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb0c2-9f26-4a3a-a3e2-f143b7f20a01 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:45.919572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 598/1206] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:28:45.924821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe7d8-f0ea-40cb-bb61-d0da90d07361 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:45.925264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe7d8-f0ea-40cb-bb61-d0da90d07361 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:45.925442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe7d8-f0ea-40cb-bb61-d0da90d07361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:45.942070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-951fe7d8-f0ea-40cb-bb61-d0da90d07361 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:28:45.943264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-951fe7d8-f0ea-40cb-bb61-d0da90d07361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:28:46.007231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 609/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:28:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:28:46.031069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb0c2-9f26-4a3a-a3e2-f143b7f20a01 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:46.130297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb0c2-9f26-4a3a-a3e2-f143b7f20a01 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:46.163349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:46.164159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:46.164441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:46.164719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:46.179288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:28:46.182582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:46.183977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:46.185028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 599/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:28:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:46.189946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe7d8-f0ea-40cb-bb61-d0da90d07361 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:46.228343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:46.291335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe7d8-f0ea-40cb-bb61-d0da90d07361 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:46.326587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:46.327255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:46.327542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:46.327818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:46.328557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:46.328868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:46.330259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:46.337933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 610/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:28:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:46.343618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:46.393305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:46.441577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c4b56-2431-4a42-bc1b-e88c38833a8f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:46.475088 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:46.475860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:46.476162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:46.476418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:46.486173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:46.487642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:46.505135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:46.512585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:46.513665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:46.513665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:46.513665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:46.513665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:46.513665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 600/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:46.514011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:46.607954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:46.610848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8434c-0741-452b-b562-4ebb80f88f95 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:46.648567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:46.649261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:46.649551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:46.649828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:46.650577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:46.650889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:46.652285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:46.664712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 611/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:28:46.670298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:46.767537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69020a-c6e3-4876-a2d3-975ac011e8b3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:46.768973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:46.800500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:46.801286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:46.801570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:46.801841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:46.810050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:46.811523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:28:46.826318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:46.827323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:46.828435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 601/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:46.833202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:46.933061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352110bb-a399-46f9-bb99-ec4d7d8c048f None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:46.966118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:46.966816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:46.967099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:46.967374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:46.968199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:46.968546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:46.969974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:46.988634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 612/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 19 21:28:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:46.995208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:47.095048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca038-1a50-44a8-b8e8-1d3227d2ef6d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:47.128089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:47.128727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:47.129010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:47.129285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:47.158533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:47.198443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:47.199914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:47.301401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 602/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:28:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:28:47.307170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:47.327295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:47.405500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0b783-02cf-4190-8584-8f576821ce69 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:47.438144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:47.438946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:47.439228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:47.439500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:47.449909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:47.451950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:47.468833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:47.469875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:47.477483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:47.477483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:47.477483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:47.477483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:47.477483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 613/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:47.477826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:47.536046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:47.581333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa3627-8c12-4eb0-8ce4-86d70a42b4ca None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:47.617739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:47.618416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:47.618784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:47.619199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:47.620080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:47.620382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:47.621749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:47.633236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 603/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:47.638967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:47.706266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:47.735133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727fd19-8d46-4039-b992-11a1dc16a471 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:47.767099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:47.767875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:47.768166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:47.768434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:47.775444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:47.776868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:28:47.790807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:47.791942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:47.793049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 614/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:47.798052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:47.897664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec485b96-0ba7-46e2-b8fa-1588e9bc816e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:47.925219 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:47.937072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4495c-c3f7-4091-909a-35799f8d7513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:47.937729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4495c-c3f7-4091-909a-35799f8d7513 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:47.938011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4495c-c3f7-4091-909a-35799f8d7513 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:47.938321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4495c-c3f7-4091-909a-35799f8d7513 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:47.939094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4495c-c3f7-4091-909a-35799f8d7513 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:47.939404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4495c-c3f7-4091-909a-35799f8d7513 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:47.940839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4495c-c3f7-4091-909a-35799f8d7513 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:47.952888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 604/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:47.959019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:48.055932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45efd-7ef0-4f8c-8f06-59d44278d235 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:48.083358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:48.088836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a5bb0-4621-4b19-8ba9-40b05da604ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:48.089479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5bb0-4621-4b19-8ba9-40b05da604ee None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:48.089762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5bb0-4621-4b19-8ba9-40b05da604ee None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:48.090037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5bb0-4621-4b19-8ba9-40b05da604ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:48.090884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5bb0-4621-4b19-8ba9-40b05da604ee None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=08c36dedeee54c2c84db268a76d4b37e) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:48.091195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5bb0-4621-4b19-8ba9-40b05da604ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:48.093051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5bb0-4621-4b19-8ba9-40b05da604ee None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:48.098557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 615/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:28:47 2022] GET /identity/v3/role_assignments?user.id=08c36dedeee54c2c84db268a76d4b37e&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:50.287960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6dad-e95c-4b28-8686-9eb713697548 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:50.291712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6dad-e95c-4b28-8686-9eb713697548 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:50.291712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6dad-e95c-4b28-8686-9eb713697548 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:50.291712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 605/1220] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:28:50.295362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f77b5-6739-48e1-9b5c-0df17845dbed None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:50.295755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f77b5-6739-48e1-9b5c-0df17845dbed None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:50.295920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f77b5-6739-48e1-9b5c-0df17845dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:50.312930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c59f77b5-6739-48e1-9b5c-0df17845dbed None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:28:50.314724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c59f77b5-6739-48e1-9b5c-0df17845dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:28:50.389703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 616/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:28:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:28:50.411666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6dad-e95c-4b28-8686-9eb713697548 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:50.510497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6dad-e95c-4b28-8686-9eb713697548 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:50.543553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:50.544293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:50.544572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:50.544844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:50.555396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:28:50.563566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:50.564686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:50.565749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 606/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:50.570840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f77b5-6739-48e1-9b5c-0df17845dbed None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:50.664825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f77b5-6739-48e1-9b5c-0df17845dbed None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:50.689290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:50.700848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:50.707244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:50.707244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:50.707244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:50.707244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:50.707244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:50.707244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:50.712328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 617/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:50.718332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:50.762371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:50.818734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaaac2-d9eb-4c16-910a-b77c315e3099 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:50.850980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:50.852319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:50.852604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:50.852877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:50.863321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:50.864769 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:50.882080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:50.883243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:50.884145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:50.884145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:50.884145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:50.884145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:50.884145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 607/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:28:50.890387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:50.991942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92da14-47f6-48d7-a49c-4c71f34a1b89 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:51.024786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:51.025446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:51.025725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:51.025997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:51.026739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:51.027048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:51.028412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:51.040343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 618/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:51.046113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:51.139783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:51.146335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce570c6-3b64-4b81-9365-9c4910076cf8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:51.179493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:51.180290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:51.180577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:51.180884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:51.188518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:51.189972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:28:51.204695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:51.205839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:51.207024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 608/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:51.212299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:51.258861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:51.315598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fca84d-b025-41d5-8f16-4dec11f267ba None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:51.349315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:51.349979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:51.350291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:51.350575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:51.351444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:51.351968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:51.353687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:51.370892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 619/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 19 21:28:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:51.376715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:51.477263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921aee-e6ef-415e-9c73-4f5b2420ee88 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:51.509205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:51.509974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:51.510279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:51.510557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:51.520651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:51.522091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:51.539150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:51.540043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:51.541066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:51.541066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:51.541066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:51.541066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:51.541066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 609/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:51.545933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:51.642430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0977af6-ab6c-4788-bac4-a1b37a4ffd2b None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:51.644773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:51.675865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:51.676522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:51.676808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:51.677086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:51.677797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:51.678109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:51.680130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:51.691574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 620/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:51.697761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:51.707187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:51.795654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a487-cb33-4648-91cd-8983a199fe83 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:51.830046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:51.830852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:51.831134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:51.831406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:51.842132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:51.844067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:28:51.858452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:51.859466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:51.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 610/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:51.865451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:51.961717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd3f9d-a71a-4d20-9052-54d87755c997 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:51.995021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d284c8-0909-43a6-a187-f80b0d5d66fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:51.995671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d284c8-0909-43a6-a187-f80b0d5d66fa None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:51.995955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d284c8-0909-43a6-a187-f80b0d5d66fa None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:51.996233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d284c8-0909-43a6-a187-f80b0d5d66fa None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:51.997002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d284c8-0909-43a6-a187-f80b0d5d66fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:51.997319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d284c8-0909-43a6-a187-f80b0d5d66fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:51.998777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d284c8-0909-43a6-a187-f80b0d5d66fa None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:52.010357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 621/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:52.016345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:52.083628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:52.117832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916846b2-d268-4f6e-b28c-e1efbcf9519d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:52.150559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aec20-e161-4541-8aac-7bdbf8faeede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:52.151477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aec20-e161-4541-8aac-7bdbf8faeede None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:52.151769 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aec20-e161-4541-8aac-7bdbf8faeede None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:52.152047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aec20-e161-4541-8aac-7bdbf8faeede None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/08c36dedeee54c2c84db268a76d4b37e/roles/24d080895b854a35950230f3ec003570` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:52.166631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29aec20-e161-4541-8aac-7bdbf8faeede None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=08c36dedeee54c2c84db268a76d4b37e, role_id=24d080895b854a35950230f3ec003570)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:52.168091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29aec20-e161-4541-8aac-7bdbf8faeede None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:52.303250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 611/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:28:52 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/08c36dedeee54c2c84db268a76d4b37e/roles/24d080895b854a35950230f3ec003570 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:28:54.568840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593997-6f9b-4cd0-b709-2aa22a089427 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:54.569397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593997-6f9b-4cd0-b709-2aa22a089427 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:54.569397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593997-6f9b-4cd0-b709-2aa22a089427 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:54.571377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 622/1233] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:28:54.576645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebf018-4c53-439c-bd83-425cca8d98c3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:54.577042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebf018-4c53-439c-bd83-425cca8d98c3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:54.577208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebf018-4c53-439c-bd83-425cca8d98c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:54.593363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9cebf018-4c53-439c-bd83-425cca8d98c3 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:28:54.594594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9cebf018-4c53-439c-bd83-425cca8d98c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:28:54.665713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 612/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:28:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:28:54.701215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593997-6f9b-4cd0-b709-2aa22a089427 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:54.731050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:54.803340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593997-6f9b-4cd0-b709-2aa22a089427 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:54.835414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69741d27-f786-48d7-a515-7b046859554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:54.836636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69741d27-f786-48d7-a515-7b046859554d None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:54.836915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69741d27-f786-48d7-a515-7b046859554d None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:54.837184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69741d27-f786-48d7-a515-7b046859554d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:54.846717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69741d27-f786-48d7-a515-7b046859554d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-69741d27-f786-48d7-a515-7b046859554d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:28:54.854895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:54.856001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:54.856961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 623/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 19 21:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:54.862102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebf018-4c53-439c-bd83-425cca8d98c3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:54.907496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:54.959022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebf018-4c53-439c-bd83-425cca8d98c3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:54.993043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:54.993711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:54.993995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:54.994307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:54.995365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:54.995680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:54.997128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:55.012826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 613/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 19 21:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:55.022502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69741d27-f786-48d7-a515-7b046859554d None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:55.107814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:55.123178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69741d27-f786-48d7-a515-7b046859554d None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:55.156240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:55.157041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:55.157322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:55.157592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:55.167786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:55.169255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:55.185904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:55.186985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:55.188368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:55.188368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:55.188368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:55.188368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:55.188368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 624/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:55.192795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:55.290864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d235d-6555-4882-8a7e-ba06371baae8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:55.300091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:55.325468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72638b7-6247-450d-accd-12788714d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:55.326119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72638b7-6247-450d-accd-12788714d590 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:55.326430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72638b7-6247-450d-accd-12788714d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:55.326707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72638b7-6247-450d-accd-12788714d590 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:55.327412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72638b7-6247-450d-accd-12788714d590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:55.327717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72638b7-6247-450d-accd-12788714d590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:55.329109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72638b7-6247-450d-accd-12788714d590 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:55.340212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 614/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:55.345891 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:55.443357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a507-37a1-4ca6-b2b9-5e4782d0b598 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:55.476132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:55.476948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:55.477267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:55.477539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:55.480150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:55.485127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:55.486592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:28:55.500755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:55.518499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:55.519705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 625/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:55.520428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72638b7-6247-450d-accd-12788714d590 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:55.606789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72638b7-6247-450d-accd-12788714d590 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:55.639243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:55.639896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:55.640178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:55.640448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:55.641265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:55.641572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:55.643030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:55.660341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 615/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 19 21:28:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:55.666777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:55.764659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6021e-63af-4678-a63d-434a3b4f7c6e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:55.797138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:55.797767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:55.798047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:55.798351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:55.856914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:55.863176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:55.864609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:55.957671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 626/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:28:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:28:55.964153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:56.000298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:56.078138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527ad4f-dc5c-4452-b1c7-434e0aab410b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:56.111317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:56.112101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:56.112384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:56.112661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:56.122968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:56.124413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:56.141895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:56.142960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:56.143877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:56.143877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:56.143877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:56.143877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:56.143877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 616/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:56.148897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:56.238956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:56.245351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5325a2b-4dae-4141-8c60-10ce2320fe95 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:56.281369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:56.281369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:56.281680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:56.281944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:56.282701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:56.283011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:56.284371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:56.295714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 627/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:56.301350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:56.381495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:56.404215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796c2ee-04bb-4c93-85d5-e67d649dc3f6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:56.446511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:56.447312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:56.447594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:56.447869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:56.455213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:56.456672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:28:56.471064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:56.472164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:28:56.473161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 617/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:56.478323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:56.581212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0063f-7619-4fef-9af5-0a1a5d2f4847 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:56.617213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbb7a3-5b57-43cb-b8d0-da9972b7fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:56.617887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb7a3-5b57-43cb-b8d0-da9972b7fe3c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:56.618299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb7a3-5b57-43cb-b8d0-da9972b7fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:56.618584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb7a3-5b57-43cb-b8d0-da9972b7fe3c None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:56.619554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbb7a3-5b57-43cb-b8d0-da9972b7fe3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:56.619878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbb7a3-5b57-43cb-b8d0-da9972b7fe3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:56.621378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbb7a3-5b57-43cb-b8d0-da9972b7fe3c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:56.634538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 628/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:56.640477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:56.741317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd8c65-073c-4d95-8590-036b68c188bd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:56.774905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2211-a933-4cd8-9f71-41bca7cbebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:56.775543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2211-a933-4cd8-9f71-41bca7cbebab None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:56.775822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2211-a933-4cd8-9f71-41bca7cbebab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:56.776091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2211-a933-4cd8-9f71-41bca7cbebab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:56.776940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2211-a933-4cd8-9f71-41bca7cbebab None admin] RBAC: Adding query filter params (role.id=24d080895b854a35950230f3ec003570, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=08c36dedeee54c2c84db268a76d4b37e) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:56.777247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2211-a933-4cd8-9f71-41bca7cbebab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:56.778701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2211-a933-4cd8-9f71-41bca7cbebab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:56.784353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 618/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:28:56 2022] GET /identity/v3/role_assignments?user.id=08c36dedeee54c2c84db268a76d4b37e&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=24d080895b854a35950230f3ec003570 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:59.019177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892779-5300-4f70-bb50-b0700edcc96e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:59.019753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892779-5300-4f70-bb50-b0700edcc96e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:59.019753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892779-5300-4f70-bb50-b0700edcc96e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:59.021112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 629/1247] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:28:59.026388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa971d7-f2bb-45d9-b2d4-736d3beaf1ed None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:59.026793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa971d7-f2bb-45d9-b2d4-736d3beaf1ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:59.026946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa971d7-f2bb-45d9-b2d4-736d3beaf1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:59.032045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:59.044609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-aaa971d7-f2bb-45d9-b2d4-736d3beaf1ed None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:28:59.045813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-aaa971d7-f2bb-45d9-b2d4-736d3beaf1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:28:59.113182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 619/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:28:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:28:59.136233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52892779-5300-4f70-bb50-b0700edcc96e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:59.154311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:59.236842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52892779-5300-4f70-bb50-b0700edcc96e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:59.270033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:59.270788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:59.271073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:59.271347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:59.283296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:28:59.291637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:59.292788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:59.293698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 630/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:59.298732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa971d7-f2bb-45d9-b2d4-736d3beaf1ed None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:59.397112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa971d7-f2bb-45d9-b2d4-736d3beaf1ed None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:59.426960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:59.431743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:59.432404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:59.432691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:59.432972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:59.433973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:59.434307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:59.435701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:59.444279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 620/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:59.450698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:59.527766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:59.549932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a0718-b2f2-46be-b578-b1e7ada08c43 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:59.583607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:59.584398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:59.584684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:59.585006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:59.595910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:59.597355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:28:59.614015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:59.617108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:59.618254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:28:59.618254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:28:59.618254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:28:59.618254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:59.618254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 631/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:59.621070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:59.720539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67640f9-4b4d-4154-90a3-1e0f140ec79a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:59.753331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:59.753989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:59.754300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:59.754577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:59.755282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:28:59.755585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:59.757027 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:59.769043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 621/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:28:59.775188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:59.873163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aba86-c9a5-4cb2-bbf3-35778434b11c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:28:59.899019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:28:59.906470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:28:59.907263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:28:59.907547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:28:59.907822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:28:59.915090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:28:59.916521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:28:59.931183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:28:59.932273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:28:59.933676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 632/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:28:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:28:59.938385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:28:59.993191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:00.036885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b59ac-479e-4f91-872b-eb73a189d15f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:00.070681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:00.071416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:00.071704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:00.071986 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:00.072809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:00.073121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:00.074570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:00.091169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 622/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 19 21:28:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:00.096922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:00.195092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d6ef0-2747-4bb3-aae7-7cce11ad467e None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:00.228063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:00.228703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:00.228987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:00.229264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:00.282811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:00.295295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:00.296750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:00.400937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 633/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:29:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:29:00.406945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:00.513880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0066783-a701-4bba-996b-8fa879f629f5 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:00.526629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:00.546720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:00.547500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:00.547782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:00.548056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:00.558660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:00.560122 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:29:00.577107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:00.577998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:00.579234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:29:00.579234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:29:00.579234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:00.579234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:00.579234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 623/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:00.583984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:00.668518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:00.680395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d68d0d-6560-4111-bb2d-32699cb8fdd2 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:00.712326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:00.712981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:00.713258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:00.713526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:00.714247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:00.714554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:00.715902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:00.727632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 634/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:00.733222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:00.840843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cde19-8285-4e83-bf4a-0693cc64bb04 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:00.873946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:00.874751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:00.875036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:00.875315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:00.882112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:00.884179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:29:00.897894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:00.898967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:00.899885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 624/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:00.905104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:01.004594 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96fe0e-d169-4d28-a984-3b3e59a68283 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:01.044293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036edce-7db7-4d69-bfc6-a5fb1dc9cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:01.045023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036edce-7db7-4d69-bfc6-a5fb1dc9cba0 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:01.045305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036edce-7db7-4d69-bfc6-a5fb1dc9cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:01.045579 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036edce-7db7-4d69-bfc6-a5fb1dc9cba0 None admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:01.046488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036edce-7db7-4d69-bfc6-a5fb1dc9cba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:01.046795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036edce-7db7-4d69-bfc6-a5fb1dc9cba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:01.048302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036edce-7db7-4d69-bfc6-a5fb1dc9cba0 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:01.063486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 635/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:01.069517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:01.099433 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:01.167402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee515-ab76-4a14-a6d6-5a1e9931170b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:01.201490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f90f-a483-43c6-8de5-d43a7882c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:01.202141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f90f-a483-43c6-8de5-d43a7882c72a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:01.202502 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f90f-a483-43c6-8de5-d43a7882c72a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:01.203060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f90f-a483-43c6-8de5-d43a7882c72a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:01.203875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f90f-a483-43c6-8de5-d43a7882c72a None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=08c36dedeee54c2c84db268a76d4b37e) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:01.204363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f90f-a483-43c6-8de5-d43a7882c72a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:01.206460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f90f-a483-43c6-8de5-d43a7882c72a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:01.212450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 625/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:29:01 2022] GET /identity/v3/role_assignments?user.id=08c36dedeee54c2c84db268a76d4b37e&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:03.449521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd5e1e-fd1b-459d-9849-e7bd3fc3c2ba None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:03.450106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd5e1e-fd1b-459d-9849-e7bd3fc3c2ba None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:03.450106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd5e1e-fd1b-459d-9849-e7bd3fc3c2ba None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:03.451475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 636/1261] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:29:03.456741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab266-c7e8-4e7b-a0c4-1428092c0a38 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:03.457182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab266-c7e8-4e7b-a0c4-1428092c0a38 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:03.457283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab266-c7e8-4e7b-a0c4-1428092c0a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:03.472948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dfaab266-c7e8-4e7b-a0c4-1428092c0a38 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:29:03.474485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dfaab266-c7e8-4e7b-a0c4-1428092c0a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:29:03.538993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 626/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:29:03.562056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd5e1e-fd1b-459d-9849-e7bd3fc3c2ba None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:03.573002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:03.661423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd5e1e-fd1b-459d-9849-e7bd3fc3c2ba None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:03.695130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:03.695915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:03.696200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:03.696479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:03.706523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:29:03.714735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:03.715923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:29:03.717240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 637/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:03.721989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab266-c7e8-4e7b-a0c4-1428092c0a38 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:03.741240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:03.820745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab266-c7e8-4e7b-a0c4-1428092c0a38 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:03.854370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:03.855032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:03.855316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:03.855591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:03.856323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:03.856630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:03.858000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:03.866335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 627/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:29:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:03.872454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:03.939200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:03.971417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806159c-85af-4b14-b5fc-181c0615d2d2 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:04.002523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:04.003302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:04.003584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:04.003855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:04.014440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:04.015968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:29:04.033782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:04.034895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:04.035892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:29:04.035892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:29:04.035892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:04.035892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:29:04.035892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 638/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:29:04.040846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:04.119573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:04.139037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31d813-3455-4dd2-8765-0a21392bb1b3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:04.171958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:04.172610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:04.172895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:04.173168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:04.173876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:04.174187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:04.175579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:04.186933 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 628/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:04.192691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:04.290726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e309-b4a7-4e6b-a48d-eb87230ea958 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:04.310996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:04.325103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:04.325901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:04.326187 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:04.326499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:04.333829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:04.335307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:29:04.349524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:04.350952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:29:04.352339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 639/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:29:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:04.356706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:04.457675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e524-bc3b-43c3-8ce5-4e8effdbd077 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:04.499351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:04.500020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:04.500306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:04.500582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:04.501416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:04.501734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:04.503192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:04.513083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:04.521218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 629/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 19 21:29:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:04.526875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:04.625742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb7002-7e1f-44d0-a53e-5c8aba070830 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:04.658678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:04.659458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:04.659738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:04.660008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:04.670760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:04.672199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:29:04.689985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:04.690964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:04.692010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:29:04.692010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:29:04.692010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:04.692010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:29:04.692010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 640/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:04.697065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:04.795259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6cb8-9b9a-42fc-b695-7694d188e25f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:04.829137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:04.829795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:04.830079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:04.830398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:04.831108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:04.831416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:04.832803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:04.843935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 630/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:04.849726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:04.881070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:04.948341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89e716-3750-4f0f-9b9f-6408ad943d35 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:04.980651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:04.981437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:04.981720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:04.981996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:04.988552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:04.990005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:29:05.004787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:05.005848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:29:05.007035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 641/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:05.011842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:05.072109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:05.114019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623a50-734e-4c97-a431-492426acf71e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:05.147450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d773c5c-dcd2-4c0b-b569-df9d22b1b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:05.148634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d773c5c-dcd2-4c0b-b569-df9d22b1b20c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:05.148918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d773c5c-dcd2-4c0b-b569-df9d22b1b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:05.149202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d773c5c-dcd2-4c0b-b569-df9d22b1b20c None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:05.150096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d773c5c-dcd2-4c0b-b569-df9d22b1b20c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:05.150446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d773c5c-dcd2-4c0b-b569-df9d22b1b20c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:05.151895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d773c5c-dcd2-4c0b-b569-df9d22b1b20c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:05.164739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 631/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:05.173073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:05.260384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:05.268768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a79f-c873-4cc7-800b-14f1b276fbda None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:05.301901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb221b-e7e4-4864-a94f-552f1a2dc6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:05.304570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb221b-e7e4-4864-a94f-552f1a2dc6ee None admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:05.304570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb221b-e7e4-4864-a94f-552f1a2dc6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:05.304570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb221b-e7e4-4864-a94f-552f1a2dc6ee None admin] PATH_INFO: `/v3/projects/66bb396a7a0144a78064b22c09912555/users/08c36dedeee54c2c84db268a76d4b37e/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:05.305666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb221b-e7e4-4864-a94f-552f1a2dc6ee None admin] RBAC: Authorizing `identity:create_grant(project_id=66bb396a7a0144a78064b22c09912555, user_id=08c36dedeee54c2c84db268a76d4b37e, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:05.307208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb221b-e7e4-4864-a94f-552f1a2dc6ee None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:05.421593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 642/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 19 21:29:05 2022] PUT /identity/v3/projects/66bb396a7a0144a78064b22c09912555/users/08c36dedeee54c2c84db268a76d4b37e/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:29:07.589522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8fe1d-e42e-4054-9d50-ca67949e8113 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:07.590024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8fe1d-e42e-4054-9d50-ca67949e8113 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:07.590024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8fe1d-e42e-4054-9d50-ca67949e8113 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:07.591446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 632/1274] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:29:07.596711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c59ce-255c-4d5f-a166-bebd2788a8d0 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:07.597114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c59ce-255c-4d5f-a166-bebd2788a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:07.597277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c59ce-255c-4d5f-a166-bebd2788a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:07.613954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-941c59ce-255c-4d5f-a166-bebd2788a8d0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:29:07.616451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-941c59ce-255c-4d5f-a166-bebd2788a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:29:07.680633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 643/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:29:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:29:07.704336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8fe1d-e42e-4054-9d50-ca67949e8113 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:07.804773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8fe1d-e42e-4054-9d50-ca67949e8113 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:07.822139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:07.838736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:07.839514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:07.839844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:07.840074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:07.849917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:29:07.857645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:07.860139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:07.861172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 633/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 19 21:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:07.864949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c59ce-255c-4d5f-a166-bebd2788a8d0 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:07.947601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:07.965132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c59ce-255c-4d5f-a166-bebd2788a8d0 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:07.996880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:07.997542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:07.997827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:07.998101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:07.998873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:07.999181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:08.000540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:08.008761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 644/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 19 21:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:08.014621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:08.114336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602edb2-4608-4998-bf8d-d37479283114 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:08.147612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:08.148418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:08.148705 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:08.148985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:08.160219 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:08.161657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:29:08.178470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:08.182894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:08.184247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:29:08.184247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:29:08.184247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:08.184247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:08.184247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 634/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:08.186372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:08.285516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eee3b-c536-4659-ac98-e4db3e38bd68 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:08.320256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:08.320928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:08.321218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:08.321495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:08.322202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:08.322711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:08.324079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:08.335739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 645/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:08.341363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:08.371894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:08.440717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3dfa-3476-47a5-88d7-575b399fc467 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:08.473086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:08.473873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:08.474158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:08.474464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:08.482228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:08.483682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:29:08.500764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:08.501865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:08.502935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 635/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:29:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:08.509567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:08.515233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:08.613682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c33b-4524-4568-a39c-b31a82a08c7c None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:08.646572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:08.647228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:08.647511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:08.647852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:08.648682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:08.648991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:08.650449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:08.667747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 646/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 19 21:29:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:08.673437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:08.763046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:08.772116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528be1-43b9-47fe-bf4f-1f0131f2d034 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:08.805424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:08.806108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:08.806429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:08.823639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:08.877264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:08.878827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:08.965822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:08.975600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 636/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 19 21:29:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:29:08.982088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:09.043106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:09.079821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24163f9-9ed1-4ace-a8db-ee7d99821811 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:09.119312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:09.120108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:09.120391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:09.120661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:09.131695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:09.140174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:29:09.151657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:09.152751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:09.153873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:29:09.153873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:29:09.153873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:29:09.153873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:29:09.153873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 647/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:09.158679 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:09.256384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead700a-7c8e-424d-8909-c682fbf2e9c1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:09.290133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:09.290808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:09.291087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:09.291356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:09.292061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:09.292364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:09.293712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:09.304864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 637/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 19 21:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:09.310853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:09.407783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e085d-1fe6-4ddb-888d-88c0991ee3a9 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:09.421421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:09.440379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:09.441158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:09.441438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:09.441711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:09.448618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:09.450050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:29:09.464431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application with Lock( May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:09.465542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: ERROR keystone.server.flask.application May 19 21:29:09.466663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 648/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 19 21:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:09.472894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:09.525841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:09.573713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a90d8-2178-4a59-ac9d-2e01e7d899ee None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:09.607180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83583108-0bf2-4970-971d-00a4a6863834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:09.607833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583108-0bf2-4970-971d-00a4a6863834 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:09.608119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583108-0bf2-4970-971d-00a4a6863834 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:09.608396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583108-0bf2-4970-971d-00a4a6863834 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:09.609176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83583108-0bf2-4970-971d-00a4a6863834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:09.609486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83583108-0bf2-4970-971d-00a4a6863834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:09.610934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83583108-0bf2-4970-971d-00a4a6863834 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:09.623224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 638/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 19 21:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:09.629281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:09.729019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525a92d-36cb-4539-ba2d-9a757ea38d40 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:09.761300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8961a-3912-48ba-ba25-9c7d7d771c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:09.761953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8961a-3912-48ba-ba25-9c7d7d771c45 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:09.762288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8961a-3912-48ba-ba25-9c7d7d771c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:09.762655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8961a-3912-48ba-ba25-9c7d7d771c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:09.764210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8961a-3912-48ba-ba25-9c7d7d771c45 None admin] RBAC: Adding query filter params (role.id=11cd7e23a6344d30b5af1fc2f1967ab3, scope.project.id=66bb396a7a0144a78064b22c09912555, user.id=08c36dedeee54c2c84db268a76d4b37e) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:09.764541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8961a-3912-48ba-ba25-9c7d7d771c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:09.765997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8961a-3912-48ba-ba25-9c7d7d771c45 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:09.772335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 649/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 19 21:29:09 2022] GET /identity/v3/role_assignments?user.id=08c36dedeee54c2c84db268a76d4b37e&scope.project.id=66bb396a7a0144a78064b22c09912555&role.id=11cd7e23a6344d30b5af1fc2f1967ab3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:11.995450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee70c-4ba7-4c97-89cd-76415733e8d3 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:11.996014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee70c-4ba7-4c97-89cd-76415733e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:11.996014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee70c-4ba7-4c97-89cd-76415733e8d3 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:11.997416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 639/1288] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:29:12.002763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746843e-6507-4dc7-bec9-c7c24d52da98 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:12.003233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746843e-6507-4dc7-bec9-c7c24d52da98 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:12.003328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746843e-6507-4dc7-bec9-c7c24d52da98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:12.021513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5746843e-6507-4dc7-bec9-c7c24d52da98 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:29:12.022853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5746843e-6507-4dc7-bec9-c7c24d52da98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:29:12.052552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:12.092298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 650/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:29:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:29:12.114291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee70c-4ba7-4c97-89cd-76415733e8d3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:12.215256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee70c-4ba7-4c97-89cd-76415733e8d3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:12.225569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:12.248580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:12.249303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:12.249582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:12.249852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:12.250524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:12.251893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:12.263343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:12.264540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:12.265757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 640/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:29:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:12.270660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746843e-6507-4dc7-bec9-c7c24d52da98 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:12.367723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746843e-6507-4dc7-bec9-c7c24d52da98 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:12.399977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4effd5-d4d2-47f0-8599-35227cde1219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:12.400630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4effd5-d4d2-47f0-8599-35227cde1219 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:12.400912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4effd5-d4d2-47f0-8599-35227cde1219 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:12.401186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4effd5-d4d2-47f0-8599-35227cde1219 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:12.401875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4effd5-d4d2-47f0-8599-35227cde1219 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:12.402182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4effd5-d4d2-47f0-8599-35227cde1219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:12.403575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4effd5-d4d2-47f0-8599-35227cde1219 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:12.408279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 651/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 19 21:29:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:12.414573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:12.513158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002a07-39a0-4b76-8251-1d807a1ecc06 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:12.545467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca5190-d1a4-456a-94d2-9b7f43720db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:12.546111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5190-d1a4-456a-94d2-9b7f43720db2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:12.546426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5190-d1a4-456a-94d2-9b7f43720db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:12.546701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5190-d1a4-456a-94d2-9b7f43720db2 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:12.547395 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca5190-d1a4-456a-94d2-9b7f43720db2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:12.547702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca5190-d1a4-456a-94d2-9b7f43720db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:12.549079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca5190-d1a4-456a-94d2-9b7f43720db2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:12.553396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 641/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 19 21:29:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:14.719775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744122be-20d5-4554-b870-5e8e9a369d3a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:14.720319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744122be-20d5-4554-b870-5e8e9a369d3a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:14.720413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744122be-20d5-4554-b870-5e8e9a369d3a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:14.721752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 652/1293] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:29:14.727538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70ffb-30dc-4f10-be22-7ec3e8ef5abb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:14.727947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70ffb-30dc-4f10-be22-7ec3e8ef5abb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:14.728094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70ffb-30dc-4f10-be22-7ec3e8ef5abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:14.745041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dfd70ffb-30dc-4f10-be22-7ec3e8ef5abb None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:29:14.746242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dfd70ffb-30dc-4f10-be22-7ec3e8ef5abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:29:14.775182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:14.811641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 642/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:29:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:29:14.834443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744122be-20d5-4554-b870-5e8e9a369d3a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:14.865332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:14.933822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744122be-20d5-4554-b870-5e8e9a369d3a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:14.966743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b489b-adf8-46a1-a575-06c6bcf0849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:14.967391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b489b-adf8-46a1-a575-06c6bcf0849c None admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:14.967673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b489b-adf8-46a1-a575-06c6bcf0849c None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:14.967954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b489b-adf8-46a1-a575-06c6bcf0849c None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:14.968699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b489b-adf8-46a1-a575-06c6bcf0849c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:14.970190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b489b-adf8-46a1-a575-06c6bcf0849c None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:15.066720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 653/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 19 21:29:14 2022] POST /identity/v3/services => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:29:17.275247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9071-15de-41a3-9399-2b39a309e512 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:17.275808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9071-15de-41a3-9399-2b39a309e512 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:17.275808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9071-15de-41a3-9399-2b39a309e512 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:17.277240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 643/1296] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:29:17.283528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce4ab-57fb-4201-a734-0d4b0a36204e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:17.283953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce4ab-57fb-4201-a734-0d4b0a36204e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:17.284141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce4ab-57fb-4201-a734-0d4b0a36204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:17.300983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ef3ce4ab-57fb-4201-a734-0d4b0a36204e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:29:17.302169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ef3ce4ab-57fb-4201-a734-0d4b0a36204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:29:17.373644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 654/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:29:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:29:17.396071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b9071-15de-41a3-9399-2b39a309e512 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:17.497120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b9071-15de-41a3-9399-2b39a309e512 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:17.530845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:17.531565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:17.531863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:17.532125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:17.532774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:17.534142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:17.545702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:17.546906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:17.547760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 644/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:29:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:17.552986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce4ab-57fb-4201-a734-0d4b0a36204e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:17.571511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:17.648842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce4ab-57fb-4201-a734-0d4b0a36204e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:17.681915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:17.682605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:17.684959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:17.684959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:17.684959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:17.684959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:17.685808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:17.690886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 655/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 19 21:29:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:17.697207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:17.728190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:17.796996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceec9f-b740-4585-987b-1e203b739f89 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:17.830771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66e43f-310f-46d8-9e32-708b8ff73776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:17.831411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66e43f-310f-46d8-9e32-708b8ff73776 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:17.831691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66e43f-310f-46d8-9e32-708b8ff73776 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:17.831964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66e43f-310f-46d8-9e32-708b8ff73776 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:17.832736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66e43f-310f-46d8-9e32-708b8ff73776 None admin] RBAC: Adding query filter params (interface=public, service_id=0a16f567764140bdac4dfe2f8d5ab801, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:17.833045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66e43f-310f-46d8-9e32-708b8ff73776 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:17.834412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66e43f-310f-46d8-9e32-708b8ff73776 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:17.839331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 645/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 19 21:29:17 2022] GET /identity/v3/endpoints?service_id=0a16f567764140bdac4dfe2f8d5ab801&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:17.845177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:17.924553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:17.942879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4758-9f51-4376-8e18-2ece3cbb2bb4 None admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:17.976007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d3a1-f402-453a-b099-9d4b8f1d7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:17.976668 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d3a1-f402-453a-b099-9d4b8f1d7af6 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:17.976954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d3a1-f402-453a-b099-9d4b8f1d7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:17.977231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d3a1-f402-453a-b099-9d4b8f1d7af6 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:17.977952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d3a1-f402-453a-b099-9d4b8f1d7af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:17.979462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d3a1-f402-453a-b099-9d4b8f1d7af6 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:17.986492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 656/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 19 21:29:17 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:29:20.198264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f509ab-bfe8-48ca-8e9d-6cb3f318fa2a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:20.198792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f509ab-bfe8-48ca-8e9d-6cb3f318fa2a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:20.198907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f509ab-bfe8-48ca-8e9d-6cb3f318fa2a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:20.200239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 646/1302] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:29:20.205355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b122db-3135-49ee-b850-2108a9e44eec None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:20.205726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b122db-3135-49ee-b850-2108a9e44eec None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:20.205918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b122db-3135-49ee-b850-2108a9e44eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:20.222019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-00b122db-3135-49ee-b850-2108a9e44eec None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:29:20.223223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-00b122db-3135-49ee-b850-2108a9e44eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:29:20.288508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 657/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:29:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:29:20.311167 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f509ab-bfe8-48ca-8e9d-6cb3f318fa2a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:20.404966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:20.411613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f509ab-bfe8-48ca-8e9d-6cb3f318fa2a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:20.445417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:20.446195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:20.446505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:20.446778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:20.447414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:20.448817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:29:20.460169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:29:20.466413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application May 19 21:29:20.467948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 647/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 19 21:29:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:29:20.468921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b122db-3135-49ee-b850-2108a9e44eec None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:20.542968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:20.565390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b122db-3135-49ee-b850-2108a9e44eec None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:20.596982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a45fa6-c08f-4770-97e8-1b8419841f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:20.597639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45fa6-c08f-4770-97e8-1b8419841f32 None admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:20.597921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45fa6-c08f-4770-97e8-1b8419841f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:20.598196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45fa6-c08f-4770-97e8-1b8419841f32 None admin] PATH_INFO: `/v3/services` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:20.598920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a45fa6-c08f-4770-97e8-1b8419841f32 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:29:20.599233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a45fa6-c08f-4770-97e8-1b8419841f32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:20.600594 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a45fa6-c08f-4770-97e8-1b8419841f32 None admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:20.606080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 658/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 19 21:29:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:29:20.611898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:29:20.712063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a5bc0-c0b2-40fa-9b5e-9aa2d58548fa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:29:20.744833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020a61c-7cd9-4b56-a66a-74b699198e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:29:20.745473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020a61c-7cd9-4b56-a66a-74b699198e01 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:29:20.745754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020a61c-7cd9-4b56-a66a-74b699198e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:29:20.746024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020a61c-7cd9-4b56-a66a-74b699198e01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:29:20.746780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020a61c-7cd9-4b56-a66a-74b699198e01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:29:20.748138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020a61c-7cd9-4b56-a66a-74b699198e01 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:29:20.848006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 648/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 19 21:29:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:29:30.624811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=30 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:29:30.843327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:26.173506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57fda-10a6-4570-9e2a-c1b0eeecefa1 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:26.174083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57fda-10a6-4570-9e2a-c1b0eeecefa1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:26.174083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57fda-10a6-4570-9e2a-c1b0eeecefa1 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:26.175629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 659/1307] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:26.181065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af79ea0-53b0-497d-9f54-143a483ae1ca None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:26.181510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af79ea0-53b0-497d-9f54-143a483ae1ca None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:26.181613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af79ea0-53b0-497d-9f54-143a483ae1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:26.270861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7af79ea0-53b0-497d-9f54-143a483ae1ca None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:26.271976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7af79ea0-53b0-497d-9f54-143a483ae1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:26.413741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 649/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:26.466689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b00b-b6b7-4bbc-a458-cbc4e34fdb17 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:26.466867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b00b-b6b7-4bbc-a458-cbc4e34fdb17 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:26.467152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b00b-b6b7-4bbc-a458-cbc4e34fdb17 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:26.468514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 660/1309] 10.222.0.59 () {54 vars in 964 bytes} [Thu May 19 21:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:26.478373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8e1f-1aa3-4074-a705-bdecdb0f5cc3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:26.478676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8e1f-1aa3-4074-a705-bdecdb0f5cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:26.478960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8e1f-1aa3-4074-a705-bdecdb0f5cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:26.623698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-eeaf8e1f-1aa3-4074-a705-bdecdb0f5cc3 None None] MFA Rules not processed for user `40b920b115454a708a14a62ead99eccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:26.625130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-eeaf8e1f-1aa3-4074-a705-bdecdb0f5cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:26.666005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:26.734557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 650/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Thu May 19 21:35:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:26.743210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b00b-b6b7-4bbc-a458-cbc4e34fdb17 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:26.745005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-dd86b00b-b6b7-4bbc-a458-cbc4e34fdb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:26.869406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b00b-b6b7-4bbc-a458-cbc4e34fdb17 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:26.948655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f83f8-1169-49e5-8243-4188bfdf9cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:26.949622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f83f8-1169-49e5-8243-4188bfdf9cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:26.950060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f83f8-1169-49e5-8243-4188bfdf9cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:26.950517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f83f8-1169-49e5-8243-4188bfdf9cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:26.952308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-df0f83f8-1169-49e5-8243-4188bfdf9cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:27.012647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:27.070307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f83f8-1169-49e5-8243-4188bfdf9cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:27.072194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f83f8-1169-49e5-8243-4188bfdf9cf3 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:27.092164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 661/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:29.669812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bdf70-fc70-4284-947a-b278da8fb60d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:29.670393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bdf70-fc70-4284-947a-b278da8fb60d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:29.670393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bdf70-fc70-4284-947a-b278da8fb60d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:29.671785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 651/1312] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:29.677301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb47d7a-d7e1-42c7-8be3-a136748d91e1 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:29.677751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb47d7a-d7e1-42c7-8be3-a136748d91e1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:29.677938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb47d7a-d7e1-42c7-8be3-a136748d91e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:29.752234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-efb47d7a-d7e1-42c7-8be3-a136748d91e1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:29.753426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-efb47d7a-d7e1-42c7-8be3-a136748d91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:29.854252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 662/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:29.891166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bdf70-fc70-4284-947a-b278da8fb60d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:29.892741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-131bdf70-fc70-4284-947a-b278da8fb60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:30.004915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bdf70-fc70-4284-947a-b278da8fb60d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:30.074888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:30.077695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93b4d7-2499-479e-99b0-c45218d8ba19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:30.078491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b4d7-2499-479e-99b0-c45218d8ba19 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:30.078784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b4d7-2499-479e-99b0-c45218d8ba19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:30.079063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b4d7-2499-479e-99b0-c45218d8ba19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:30.080824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4f93b4d7-2499-479e-99b0-c45218d8ba19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:30.191035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93b4d7-2499-479e-99b0-c45218d8ba19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:30.192495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93b4d7-2499-479e-99b0-c45218d8ba19 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:30.210747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 652/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:32.964044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23173dfb-06ba-48c6-b51f-f8413ba5af54 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:32.964612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23173dfb-06ba-48c6-b51f-f8413ba5af54 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:32.964719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23173dfb-06ba-48c6-b51f-f8413ba5af54 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:32.966606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 663/1315] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:32.971916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51db4b-60b7-4828-8dca-586c545452a4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:32.972312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51db4b-60b7-4828-8dca-586c545452a4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:32.972479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51db4b-60b7-4828-8dca-586c545452a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:33.036480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-af51db4b-60b7-4828-8dca-586c545452a4 None None] MFA Rules not processed for user `32af80d933f54c68b0bb6a2f4faaedf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:33.037673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-af51db4b-60b7-4828-8dca-586c545452a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:33.088223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:33.131893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 653/1316] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:33.171645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23173dfb-06ba-48c6-b51f-f8413ba5af54 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:33.173164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-23173dfb-06ba-48c6-b51f-f8413ba5af54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:33.183748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:33.276927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23173dfb-06ba-48c6-b51f-f8413ba5af54 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:33.348692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742828c-f041-445e-af73-e1693409875d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:33.349331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742828c-f041-445e-af73-e1693409875d service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:33.349614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742828c-f041-445e-af73-e1693409875d service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:33.349891 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742828c-f041-445e-af73-e1693409875d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:33.351542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6742828c-f041-445e-af73-e1693409875d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:33.411135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:33.456229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742828c-f041-445e-af73-e1693409875d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:33.457660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742828c-f041-445e-af73-e1693409875d service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:33.475727 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 664/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:36.538927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93aa1-56a2-49dd-82f5-0e2e17e3a59f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:36.539434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93aa1-56a2-49dd-82f5-0e2e17e3a59f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:36.539434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93aa1-56a2-49dd-82f5-0e2e17e3a59f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:36.540786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 654/1318] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:36.546074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce3eb-755b-4f13-8cc2-ef90014b4330 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:36.546478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce3eb-755b-4f13-8cc2-ef90014b4330 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:36.546679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce3eb-755b-4f13-8cc2-ef90014b4330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:36.609981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-247ce3eb-755b-4f13-8cc2-ef90014b4330 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:36.611207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-247ce3eb-755b-4f13-8cc2-ef90014b4330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:36.705591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 665/1319] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:36.743625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93aa1-56a2-49dd-82f5-0e2e17e3a59f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:36.745125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7ab93aa1-56a2-49dd-82f5-0e2e17e3a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:36.846409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93aa1-56a2-49dd-82f5-0e2e17e3a59f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:36.918479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06517cfa-bc6c-429c-bdab-471488adff7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:36.919116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517cfa-bc6c-429c-bdab-471488adff7e service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:36.919396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517cfa-bc6c-429c-bdab-471488adff7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:36.919671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517cfa-bc6c-429c-bdab-471488adff7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:36.921295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-06517cfa-bc6c-429c-bdab-471488adff7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:36.928252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:37.035336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06517cfa-bc6c-429c-bdab-471488adff7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:37.036768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06517cfa-bc6c-429c-bdab-471488adff7e service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:37.054971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 655/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:40.195173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda7a4-47d0-4518-8774-3ebfe71b1404 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:40.195785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda7a4-47d0-4518-8774-3ebfe71b1404 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:40.195785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda7a4-47d0-4518-8774-3ebfe71b1404 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:40.197109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 666/1321] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:40.203029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bea1b-d442-43d8-9aee-af3a46af358b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:40.203471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bea1b-d442-43d8-9aee-af3a46af358b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:40.203596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bea1b-d442-43d8-9aee-af3a46af358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:40.268920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3e8bea1b-d442-43d8-9aee-af3a46af358b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:40.270163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3e8bea1b-d442-43d8-9aee-af3a46af358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:40.332496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:40.372037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 656/1322] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:40.407399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda7a4-47d0-4518-8774-3ebfe71b1404 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:40.408926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-84cda7a4-47d0-4518-8774-3ebfe71b1404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:40.428876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:40.511130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda7a4-47d0-4518-8774-3ebfe71b1404 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:40.590051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe300d-9978-4499-9e1c-3e9a964107ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:40.591137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe300d-9978-4499-9e1c-3e9a964107ce service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:40.591614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe300d-9978-4499-9e1c-3e9a964107ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:40.592054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe300d-9978-4499-9e1c-3e9a964107ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:40.594795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0efe300d-9978-4499-9e1c-3e9a964107ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:40.688366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:40.725715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe300d-9978-4499-9e1c-3e9a964107ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:40.727173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe300d-9978-4499-9e1c-3e9a964107ce service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:40.745781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 667/1323] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:35:43.022580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f894-84bd-41d4-b019-a5bfb7b1e62a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:43.023247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f894-84bd-41d4-b019-a5bfb7b1e62a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:43.023247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f894-84bd-41d4-b019-a5bfb7b1e62a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:43.024678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 657/1324] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:43.030336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec68c0-3955-4de3-b45b-2586e1ea92ec None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:43.030773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec68c0-3955-4de3-b45b-2586e1ea92ec None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:43.030896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec68c0-3955-4de3-b45b-2586e1ea92ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:43.096712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a2ec68c0-3955-4de3-b45b-2586e1ea92ec None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:43.097939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a2ec68c0-3955-4de3-b45b-2586e1ea92ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:43.195349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 668/1325] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:43.231480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f894-84bd-41d4-b019-a5bfb7b1e62a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:43.232989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f0c2f894-84bd-41d4-b019-a5bfb7b1e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:43.353664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2f894-84bd-41d4-b019-a5bfb7b1e62a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:43.434547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38dd95-c099-4d73-9ff0-a6a6f71d0748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:43.435194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38dd95-c099-4d73-9ff0-a6a6f71d0748 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:43.435470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38dd95-c099-4d73-9ff0-a6a6f71d0748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:43.435749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38dd95-c099-4d73-9ff0-a6a6f71d0748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:43.437377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bf38dd95-c099-4d73-9ff0-a6a6f71d0748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:43.454464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:43.545768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38dd95-c099-4d73-9ff0-a6a6f71d0748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:43.547170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38dd95-c099-4d73-9ff0-a6a6f71d0748 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:43.565745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 658/1326] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:45.823759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3231b1-e1a9-4f97-85d2-5019b3006790 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:45.824319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3231b1-e1a9-4f97-85d2-5019b3006790 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:45.824319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3231b1-e1a9-4f97-85d2-5019b3006790 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:45.825682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 669/1327] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:45.831012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db33e-7608-4111-be72-14be013abe01 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:45.831413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db33e-7608-4111-be72-14be013abe01 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:45.831576 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db33e-7608-4111-be72-14be013abe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:45.895769 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-891db33e-7608-4111-be72-14be013abe01 None None] MFA Rules not processed for user `32af80d933f54c68b0bb6a2f4faaedf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:45.896982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-891db33e-7608-4111-be72-14be013abe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:45.962158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:45.994333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 659/1328] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:46.030757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3231b1-e1a9-4f97-85d2-5019b3006790 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:46.032275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-af3231b1-e1a9-4f97-85d2-5019b3006790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:46.063436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:46.135355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3231b1-e1a9-4f97-85d2-5019b3006790 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:46.211221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c047d-7570-4a27-9892-1b121148bdc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:46.211871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c047d-7570-4a27-9892-1b121148bdc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:46.212155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c047d-7570-4a27-9892-1b121148bdc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:46.212432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c047d-7570-4a27-9892-1b121148bdc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:46.214638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-003c047d-7570-4a27-9892-1b121148bdc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:46.295789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:46.327424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c047d-7570-4a27-9892-1b121148bdc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:46.328874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c047d-7570-4a27-9892-1b121148bdc9 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:46.347982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 670/1329] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:49.010947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3039f-d03e-432f-a2e0-72690a65ae7c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:49.011443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3039f-d03e-432f-a2e0-72690a65ae7c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:49.011443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3039f-d03e-432f-a2e0-72690a65ae7c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:49.012844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 660/1330] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:49.018110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05344e77-7394-45d6-bbc6-71faf8b660f2 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:49.018538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05344e77-7394-45d6-bbc6-71faf8b660f2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:49.018704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05344e77-7394-45d6-bbc6-71faf8b660f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:49.083398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-05344e77-7394-45d6-bbc6-71faf8b660f2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:49.084642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-05344e77-7394-45d6-bbc6-71faf8b660f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:49.186765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 671/1331] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:49.223553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3039f-d03e-432f-a2e0-72690a65ae7c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:49.225066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-46f3039f-d03e-432f-a2e0-72690a65ae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:49.330115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3039f-d03e-432f-a2e0-72690a65ae7c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:49.402485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde9cc8-c8e4-4629-81be-f80f93d19dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:49.403132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde9cc8-c8e4-4629-81be-f80f93d19dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:49.403412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde9cc8-c8e4-4629-81be-f80f93d19dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:49.403685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde9cc8-c8e4-4629-81be-f80f93d19dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:49.405314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2dde9cc8-c8e4-4629-81be-f80f93d19dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:49.433245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:49.516779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde9cc8-c8e4-4629-81be-f80f93d19dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:49.518256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde9cc8-c8e4-4629-81be-f80f93d19dd6 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:49.536671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 661/1332] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:51.835045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749dab-f78b-4537-956d-c82555a564c1 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:51.835603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749dab-f78b-4537-956d-c82555a564c1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:51.835603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749dab-f78b-4537-956d-c82555a564c1 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:51.836946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 672/1333] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:51.842305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4d30-0fed-4cdc-8c65-1649940b663b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:51.842709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4d30-0fed-4cdc-8c65-1649940b663b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:51.842875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4d30-0fed-4cdc-8c65-1649940b663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:51.907619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a4ad4d30-0fed-4cdc-8c65-1649940b663b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:51.908943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a4ad4d30-0fed-4cdc-8c65-1649940b663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:51.983981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:52.005712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 662/1334] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:52.061385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41b37-96b9-43ef-8835-70ef7d920a1b None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:52.061681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41b37-96b9-43ef-8835-70ef7d920a1b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:52.061963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41b37-96b9-43ef-8835-70ef7d920a1b None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:52.063389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 673/1335] 10.222.0.59 () {54 vars in 964 bytes} [Thu May 19 21:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:52.069327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7096-c5c1-471d-b8d6-5b94a422e1fe None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:52.069625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7096-c5c1-471d-b8d6-5b94a422e1fe None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:52.069901 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7096-c5c1-471d-b8d6-5b94a422e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:52.141703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-581f7096-c5c1-471d-b8d6-5b94a422e1fe None None] MFA Rules not processed for user `40b920b115454a708a14a62ead99eccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:52.142934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-581f7096-c5c1-471d-b8d6-5b94a422e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:52.217135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 663/1336] 10.222.0.59 () {58 vars in 1061 bytes} [Thu May 19 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:52.226001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41b37-96b9-43ef-8835-70ef7d920a1b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:52.227530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-43b41b37-96b9-43ef-8835-70ef7d920a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:52.266777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:52.329897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41b37-96b9-43ef-8835-70ef7d920a1b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:52.401889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c86e5-5990-45c4-ac79-2a930c0b119f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:52.402487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c86e5-5990-45c4-ac79-2a930c0b119f service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:52.402772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c86e5-5990-45c4-ac79-2a930c0b119f service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:52.403046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c86e5-5990-45c4-ac79-2a930c0b119f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:52.404683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-629c86e5-5990-45c4-ac79-2a930c0b119f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:52.488222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:52.513908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c86e5-5990-45c4-ac79-2a930c0b119f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:52.515396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c86e5-5990-45c4-ac79-2a930c0b119f service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:52.534769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 674/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:35:55.901162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde63fa-5aaf-41b3-9390-bc740788d1ef None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:55.901727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde63fa-5aaf-41b3-9390-bc740788d1ef None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:55.901727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde63fa-5aaf-41b3-9390-bc740788d1ef None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:55.903207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 664/1338] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:35:55.908438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13faf52-c1bf-4c04-8ebd-97b21e55a209 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:55.908882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13faf52-c1bf-4c04-8ebd-97b21e55a209 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:55.909005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13faf52-c1bf-4c04-8ebd-97b21e55a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:55.973108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b13faf52-c1bf-4c04-8ebd-97b21e55a209 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:35:55.974348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b13faf52-c1bf-4c04-8ebd-97b21e55a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:56.068834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 675/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:35:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:35:56.103249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde63fa-5aaf-41b3-9390-bc740788d1ef None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:35:56.105596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9bde63fa-5aaf-41b3-9390-bc740788d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:56.188822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:56.210511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde63fa-5aaf-41b3-9390-bc740788d1ef None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:35:56.286156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4395ae-82c6-427a-a97c-656c222943bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:35:56.286878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4395ae-82c6-427a-a97c-656c222943bd service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:35:56.287111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4395ae-82c6-427a-a97c-656c222943bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:35:56.287385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4395ae-82c6-427a-a97c-656c222943bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:35:56.289423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7b4395ae-82c6-427a-a97c-656c222943bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:35:56.403542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4395ae-82c6-427a-a97c-656c222943bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:35:56.404978 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4395ae-82c6-427a-a97c-656c222943bd service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:35:56.425262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 665/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:35:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:01.074231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7587f-4e49-4430-b4a0-d1e3dfe45357 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:01.074793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7587f-4e49-4430-b4a0-d1e3dfe45357 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:01.074793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7587f-4e49-4430-b4a0-d1e3dfe45357 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:01.076186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 676/1341] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:01.081449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b649-f963-4b80-a59b-57961aa309ad None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:01.081872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b649-f963-4b80-a59b-57961aa309ad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:01.082026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b649-f963-4b80-a59b-57961aa309ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:01.087215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:01.130472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fd73b649-f963-4b80-a59b-57961aa309ad None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:01.131666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fd73b649-f963-4b80-a59b-57961aa309ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:01.214421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 666/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:01.253050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7587f-4e49-4430-b4a0-d1e3dfe45357 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:01.255254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-baf7587f-4e49-4430-b4a0-d1e3dfe45357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:01.306808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:01.337918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7587f-4e49-4430-b4a0-d1e3dfe45357 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:01.342012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23641040-2c61-4348-acab-fda37858081f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:01.342697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641040-2c61-4348-acab-fda37858081f service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:01.342984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641040-2c61-4348-acab-fda37858081f service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:01.343265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641040-2c61-4348-acab-fda37858081f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:01.352790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23641040-2c61-4348-acab-fda37858081f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:01.354285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23641040-2c61-4348-acab-fda37858081f service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:01.363879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 677/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:04.567909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4af2-ca04-43ec-9f77-c6b975eba7b7 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:04.568447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4af2-ca04-43ec-9f77-c6b975eba7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:04.568447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4af2-ca04-43ec-9f77-c6b975eba7b7 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:04.569773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 667/1344] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:04.575043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9933-2b24-47fc-b143-2dd066b0387c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:04.575482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9933-2b24-47fc-b143-2dd066b0387c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:04.575587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9933-2b24-47fc-b143-2dd066b0387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:04.602540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7dac9933-2b24-47fc-b143-2dd066b0387c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:04.604241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7dac9933-2b24-47fc-b143-2dd066b0387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:04.612327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 678/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:04.649189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc4af2-ca04-43ec-9f77-c6b975eba7b7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:04.660296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc4af2-ca04-43ec-9f77-c6b975eba7b7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:04.663846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a16c0-2246-4282-bbef-0ea7a733947b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:04.664479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a16c0-2246-4282-bbef-0ea7a733947b service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:04.664762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a16c0-2246-4282-bbef-0ea7a733947b service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:04.665037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a16c0-2246-4282-bbef-0ea7a733947b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:04.674426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a16c0-2246-4282-bbef-0ea7a733947b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:04.676119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a16c0-2246-4282-bbef-0ea7a733947b service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:04.686063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 668/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:09.372339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91016af6-572d-4441-b3e9-002929233090 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:09.372974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91016af6-572d-4441-b3e9-002929233090 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:09.372974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91016af6-572d-4441-b3e9-002929233090 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:09.374324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 679/1347] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:09.379571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a757bb-30dd-467b-808e-eb396c85dbdc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:09.379980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a757bb-30dd-467b-808e-eb396c85dbdc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:09.380206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a757bb-30dd-467b-808e-eb396c85dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:09.397819 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-22a757bb-30dd-467b-808e-eb396c85dbdc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:09.399040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-22a757bb-30dd-467b-808e-eb396c85dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:09.407427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 669/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:36:09.446083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91016af6-572d-4441-b3e9-002929233090 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:09.457234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91016af6-572d-4441-b3e9-002929233090 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:09.460954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b947-5171-4191-b0ed-8c4166d83046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:09.461595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b947-5171-4191-b0ed-8c4166d83046 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:09.461878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b947-5171-4191-b0ed-8c4166d83046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:09.462156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b947-5171-4191-b0ed-8c4166d83046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:09.471883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b947-5171-4191-b0ed-8c4166d83046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:09.473320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b947-5171-4191-b0ed-8c4166d83046 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:09.483586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 680/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:14.938308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ff112-3159-4709-a45a-103840a9b98b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:14.939208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ff112-3159-4709-a45a-103840a9b98b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:14.939636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ff112-3159-4709-a45a-103840a9b98b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:14.941451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 670/1350] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:14.950175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e32e-eeac-4a19-b394-15acb67cb45d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:14.950776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e32e-eeac-4a19-b394-15acb67cb45d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:14.951281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e32e-eeac-4a19-b394-15acb67cb45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:15.046830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6a16e32e-eeac-4a19-b394-15acb67cb45d None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:15.047978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6a16e32e-eeac-4a19-b394-15acb67cb45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:15.151717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 681/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:36:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:36:19.393422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=52 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:19.457200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d82d-2e17-45f8-a21b-1df9e6239d80 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:19.457485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d82d-2e17-45f8-a21b-1df9e6239d80 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:19.457750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d82d-2e17-45f8-a21b-1df9e6239d80 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:19.459175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 671/1352] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:19.465413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798da2-0cf6-479d-bda8-68ffd88fc308 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:19.465931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798da2-0cf6-479d-bda8-68ffd88fc308 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:19.466036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798da2-0cf6-479d-bda8-68ffd88fc308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:19.483865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c6798da2-0cf6-479d-bda8-68ffd88fc308 None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:19.485043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c6798da2-0cf6-479d-bda8-68ffd88fc308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:19.493949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 682/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:36:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:20.857638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e60806-b477-4778-b8de-54cffb855a58 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:20.858162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e60806-b477-4778-b8de-54cffb855a58 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:20.858162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e60806-b477-4778-b8de-54cffb855a58 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:20.859701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 672/1354] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:20.865060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056dacb-d3f9-4e68-9148-0f513fd5f330 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:20.865481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056dacb-d3f9-4e68-9148-0f513fd5f330 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:20.865621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056dacb-d3f9-4e68-9148-0f513fd5f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:20.883491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9056dacb-d3f9-4e68-9148-0f513fd5f330 None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:20.885191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9056dacb-d3f9-4e68-9148-0f513fd5f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:20.893931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 683/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:36:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:24.861792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8cd2-cf10-41e1-83d5-5e4198aca17f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:24.862341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8cd2-cf10-41e1-83d5-5e4198aca17f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:24.862341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8cd2-cf10-41e1-83d5-5e4198aca17f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:24.863657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 673/1356] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:24.869375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46a71-5ee9-40ef-9fa4-345378999b0f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:24.870183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46a71-5ee9-40ef-9fa4-345378999b0f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:24.870690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46a71-5ee9-40ef-9fa4-345378999b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:24.888966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-35f46a71-5ee9-40ef-9fa4-345378999b0f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:24.890467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-35f46a71-5ee9-40ef-9fa4-345378999b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:24.898619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 684/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:24.955096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a16d-f60a-4de1-8ae5-1e0093a9d972 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:24.955602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a16d-f60a-4de1-8ae5-1e0093a9d972 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:24.956098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a16d-f60a-4de1-8ae5-1e0093a9d972 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:24.957671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 674/1358] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 19 21:36:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:24.966751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d558cd-bf42-4b22-91c5-34471d1f9c1a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:24.967126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d558cd-bf42-4b22-91c5-34471d1f9c1a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:24.967487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d558cd-bf42-4b22-91c5-34471d1f9c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:25.008586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:25.025444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-20d558cd-bf42-4b22-91c5-34471d1f9c1a None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:25.026875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-20d558cd-bf42-4b22-91c5-34471d1f9c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:25.110193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 685/1359] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 19 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:25.120777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a16d-f60a-4de1-8ae5-1e0093a9d972 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:25.135415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a16d-f60a-4de1-8ae5-1e0093a9d972 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:25.143519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f96d-dff9-428b-bd91-1a754328a672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:25.144550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f96d-dff9-428b-bd91-1a754328a672 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:25.145203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f96d-dff9-428b-bd91-1a754328a672 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:25.145656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f96d-dff9-428b-bd91-1a754328a672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:25.157808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f96d-dff9-428b-bd91-1a754328a672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:25.159694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f96d-dff9-428b-bd91-1a754328a672 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:25.172524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 675/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:27.641863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2465e-f34a-4fad-a5d9-429c62a73f93 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:27.642419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2465e-f34a-4fad-a5d9-429c62a73f93 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:27.642538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2465e-f34a-4fad-a5d9-429c62a73f93 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:27.643982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 686/1361] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:27.650156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3700443-d48c-4b25-a72e-d785ad4bca35 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:27.650647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3700443-d48c-4b25-a72e-d785ad4bca35 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:27.650777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3700443-d48c-4b25-a72e-d785ad4bca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:27.669434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a3700443-d48c-4b25-a72e-d785ad4bca35 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:27.670651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a3700443-d48c-4b25-a72e-d785ad4bca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:27.679537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 676/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:36:27.724946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2465e-f34a-4fad-a5d9-429c62a73f93 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:27.740029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2465e-f34a-4fad-a5d9-429c62a73f93 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:27.746115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993a17c-a1aa-427f-8eb5-7c01d8fc01ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:27.746782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993a17c-a1aa-427f-8eb5-7c01d8fc01ef service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:27.747070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993a17c-a1aa-427f-8eb5-7c01d8fc01ef service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:27.747350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993a17c-a1aa-427f-8eb5-7c01d8fc01ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:27.755893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993a17c-a1aa-427f-8eb5-7c01d8fc01ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:27.757486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993a17c-a1aa-427f-8eb5-7c01d8fc01ef service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:27.767625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 687/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:30.434922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b835d4-76b0-46ff-92e2-dbe8efc2d658 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:30.435376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b835d4-76b0-46ff-92e2-dbe8efc2d658 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:30.435469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b835d4-76b0-46ff-92e2-dbe8efc2d658 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:30.436861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 677/1364] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:30.442270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec05876-8b90-4b05-af73-c2d0b51ba293 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:30.442689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec05876-8b90-4b05-af73-c2d0b51ba293 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:30.443230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec05876-8b90-4b05-af73-c2d0b51ba293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:30.462819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fec05876-8b90-4b05-af73-c2d0b51ba293 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:30.464310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fec05876-8b90-4b05-af73-c2d0b51ba293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:30.472392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 688/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:30.520572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceefdfe-c347-4725-982c-698ded18f9c7 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:30.521171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceefdfe-c347-4725-982c-698ded18f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:30.521670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceefdfe-c347-4725-982c-698ded18f9c7 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:30.523127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 678/1366] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 19 21:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:30.529426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d42ed-6a9a-4b71-8453-40cae69f3199 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:30.529775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d42ed-6a9a-4b71-8453-40cae69f3199 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:30.530115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d42ed-6a9a-4b71-8453-40cae69f3199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:30.548101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b79d42ed-6a9a-4b71-8453-40cae69f3199 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:30.549202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b79d42ed-6a9a-4b71-8453-40cae69f3199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:30.558644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 689/1367] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 19 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:30.566531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceefdfe-c347-4725-982c-698ded18f9c7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:30.581115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceefdfe-c347-4725-982c-698ded18f9c7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:30.586438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f60f9-8427-483c-bce2-c35d9b831eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:30.587805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f60f9-8427-483c-bce2-c35d9b831eab service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:30.588207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f60f9-8427-483c-bce2-c35d9b831eab service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:30.588598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f60f9-8427-483c-bce2-c35d9b831eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:30.596906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f60f9-8427-483c-bce2-c35d9b831eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:30.598518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f60f9-8427-483c-bce2-c35d9b831eab service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:30.607842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 679/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:33.002101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4b2a-548f-40ab-9ec1-47c23e871c41 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.002738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4b2a-548f-40ab-9ec1-47c23e871c41 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.002738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4b2a-548f-40ab-9ec1-47c23e871c41 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.004049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 690/1369] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:33.009768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa967a5-d1ba-4998-a51c-90935518c1fc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.010301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa967a5-d1ba-4998-a51c-90935518c1fc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.010449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa967a5-d1ba-4998-a51c-90935518c1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.029332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-aaa967a5-d1ba-4998-a51c-90935518c1fc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:33.031337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-aaa967a5-d1ba-4998-a51c-90935518c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:33.041878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 680/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:33.086943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4b2a-548f-40ab-9ec1-47c23e871c41 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:33.102009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4b2a-548f-40ab-9ec1-47c23e871c41 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:33.108404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1e88-b3c7-4f99-bfe0-8b2a7e82d6f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:33.109055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1e88-b3c7-4f99-bfe0-8b2a7e82d6f0 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.109350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1e88-b3c7-4f99-bfe0-8b2a7e82d6f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.109629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1e88-b3c7-4f99-bfe0-8b2a7e82d6f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.119244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1e88-b3c7-4f99-bfe0-8b2a7e82d6f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:33.120837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1e88-b3c7-4f99-bfe0-8b2a7e82d6f0 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:33.131173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 691/1371] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:33.238463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b91d-8f42-41c1-9941-52eb83d53193 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.239638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b91d-8f42-41c1-9941-52eb83d53193 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.239638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b91d-8f42-41c1-9941-52eb83d53193 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.241796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 681/1372] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:33.248141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173cdfc-43fa-43f5-a691-0a03039e397d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.248439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173cdfc-43fa-43f5-a691-0a03039e397d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.248720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173cdfc-43fa-43f5-a691-0a03039e397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.268063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e173cdfc-43fa-43f5-a691-0a03039e397d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:33.269215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e173cdfc-43fa-43f5-a691-0a03039e397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:33.278771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 692/1373] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:33.601028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ad2d9-e57a-404b-bee2-9365a0bd2b38 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.601392 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ad2d9-e57a-404b-bee2-9365a0bd2b38 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.601762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ad2d9-e57a-404b-bee2-9365a0bd2b38 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.603697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 682/1374] 10.222.0.59 () {54 vars in 963 bytes} [Thu May 19 21:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:33.608570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aec8b-d3ae-449d-817e-4796002878ed None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.608863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aec8b-d3ae-449d-817e-4796002878ed None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.609141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aec8b-d3ae-449d-817e-4796002878ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.658985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-bf8aec8b-d3ae-449d-817e-4796002878ed None None] MFA Rules not processed for user `65573e15809c42a98cc3e603355df832`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:33.660225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-bf8aec8b-d3ae-449d-817e-4796002878ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:33.724173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 693/1375] 10.222.0.59 () {58 vars in 1060 bytes} [Thu May 19 21:36:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:33.731534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ad2d9-e57a-404b-bee2-9365a0bd2b38 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:33.742609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ad2d9-e57a-404b-bee2-9365a0bd2b38 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:33.746240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6409264-ff5a-4852-a9dd-97eb27bafb0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:33.747010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6409264-ff5a-4852-a9dd-97eb27bafb0f service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:33.747513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6409264-ff5a-4852-a9dd-97eb27bafb0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:33.747890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6409264-ff5a-4852-a9dd-97eb27bafb0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:33.757894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6409264-ff5a-4852-a9dd-97eb27bafb0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:33.760049 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6409264-ff5a-4852-a9dd-97eb27bafb0f service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:33.769989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 683/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:35.530897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606ba75-b6cd-4079-b731-84e274cd1e15 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:35.531484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606ba75-b6cd-4079-b731-84e274cd1e15 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:35.531484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606ba75-b6cd-4079-b731-84e274cd1e15 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:35.532894 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 694/1377] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:35.539059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359ff7-b487-4042-a309-fe829887b6eb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:35.540496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359ff7-b487-4042-a309-fe829887b6eb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:35.540496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359ff7-b487-4042-a309-fe829887b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:35.568533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-81359ff7-b487-4042-a309-fe829887b6eb None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:35.569754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-81359ff7-b487-4042-a309-fe829887b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:35.578238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 684/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:35.624412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606ba75-b6cd-4079-b731-84e274cd1e15 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:35.639239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606ba75-b6cd-4079-b731-84e274cd1e15 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:35.644873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fb6e9-ba01-4a72-a42a-5ede4ccb7545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:35.645559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fb6e9-ba01-4a72-a42a-5ede4ccb7545 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:35.645838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fb6e9-ba01-4a72-a42a-5ede4ccb7545 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:35.646117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fb6e9-ba01-4a72-a42a-5ede4ccb7545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:35.652193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:35.656202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fb6e9-ba01-4a72-a42a-5ede4ccb7545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:35.657843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fb6e9-ba01-4a72-a42a-5ede4ccb7545 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:35.669330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 695/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:38.107710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef38205-b34e-47f0-970b-c6ef24e80a2c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:38.108288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef38205-b34e-47f0-970b-c6ef24e80a2c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:38.108288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef38205-b34e-47f0-970b-c6ef24e80a2c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:38.109636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 685/1380] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:38.115186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c3c7-25b2-4a4e-8eda-6c95495d2f93 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:38.115648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c3c7-25b2-4a4e-8eda-6c95495d2f93 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:38.115763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c3c7-25b2-4a4e-8eda-6c95495d2f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:38.135356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7e81c3c7-25b2-4a4e-8eda-6c95495d2f93 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:38.136701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7e81c3c7-25b2-4a4e-8eda-6c95495d2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:38.144721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 696/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:38.188943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef38205-b34e-47f0-970b-c6ef24e80a2c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:38.204469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef38205-b34e-47f0-970b-c6ef24e80a2c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:38.210253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152fe9c-0433-43b3-b646-f20d59690a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:38.210895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152fe9c-0433-43b3-b646-f20d59690a03 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:38.211180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152fe9c-0433-43b3-b646-f20d59690a03 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:38.212062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152fe9c-0433-43b3-b646-f20d59690a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:38.220470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152fe9c-0433-43b3-b646-f20d59690a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:38.222049 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152fe9c-0433-43b3-b646-f20d59690a03 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:38.231750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 686/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:40.628398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5aece-ef7b-4a0d-98b7-d8493ba4e51c None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:40.628924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5aece-ef7b-4a0d-98b7-d8493ba4e51c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:40.628924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5aece-ef7b-4a0d-98b7-d8493ba4e51c None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:40.630317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 697/1383] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:40.635863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419f38d-dd19-4f0d-89c7-afe34735e667 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:40.636300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419f38d-dd19-4f0d-89c7-afe34735e667 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:40.636448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419f38d-dd19-4f0d-89c7-afe34735e667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:40.655600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7419f38d-dd19-4f0d-89c7-afe34735e667 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:40.657068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7419f38d-dd19-4f0d-89c7-afe34735e667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:40.667717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 687/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:40.713374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5aece-ef7b-4a0d-98b7-d8493ba4e51c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:40.728707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5aece-ef7b-4a0d-98b7-d8493ba4e51c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:40.735566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5058a81-19e9-4b1b-8567-d61e1b03f0cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:40.736215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5058a81-19e9-4b1b-8567-d61e1b03f0cb service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:40.736502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5058a81-19e9-4b1b-8567-d61e1b03f0cb service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:40.736781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5058a81-19e9-4b1b-8567-d61e1b03f0cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:40.751261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5058a81-19e9-4b1b-8567-d61e1b03f0cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:40.753036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5058a81-19e9-4b1b-8567-d61e1b03f0cb service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:40.764645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 698/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:43.078764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d4ef6-14b8-4fe3-86c4-8b8a3cb714dd None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:43.079443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d4ef6-14b8-4fe3-86c4-8b8a3cb714dd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:43.079443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d4ef6-14b8-4fe3-86c4-8b8a3cb714dd None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:43.080750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 688/1386] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:43.085911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fb60-dbe5-4c99-ab33-e93ec9dd5d53 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:43.086363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fb60-dbe5-4c99-ab33-e93ec9dd5d53 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:43.086542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fb60-dbe5-4c99-ab33-e93ec9dd5d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:43.104214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ce79fb60-dbe5-4c99-ab33-e93ec9dd5d53 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:43.105411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ce79fb60-dbe5-4c99-ab33-e93ec9dd5d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:43.120546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 699/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:43.160408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d4ef6-14b8-4fe3-86c4-8b8a3cb714dd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:43.175378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d4ef6-14b8-4fe3-86c4-8b8a3cb714dd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:43.181419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0defb-1870-416b-8f09-86d594020ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:43.182077 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0defb-1870-416b-8f09-86d594020ccb service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:43.182405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0defb-1870-416b-8f09-86d594020ccb service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:43.182678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0defb-1870-416b-8f09-86d594020ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:43.191118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0defb-1870-416b-8f09-86d594020ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:43.192745 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0defb-1870-416b-8f09-86d594020ccb service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:43.203518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 689/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:45.753643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ead7a-df98-4508-84af-94a6c0764f29 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:45.754266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ead7a-df98-4508-84af-94a6c0764f29 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:45.754266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ead7a-df98-4508-84af-94a6c0764f29 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:45.756046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 700/1389] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:45.763546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee304b-000b-4baa-b4c0-d36fd6755b59 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:45.764086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee304b-000b-4baa-b4c0-d36fd6755b59 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:45.764292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee304b-000b-4baa-b4c0-d36fd6755b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:45.784668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bbee304b-000b-4baa-b4c0-d36fd6755b59 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:45.785986 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bbee304b-000b-4baa-b4c0-d36fd6755b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:45.798559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 690/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:45.844563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ead7a-df98-4508-84af-94a6c0764f29 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:45.859341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ead7a-df98-4508-84af-94a6c0764f29 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:45.864964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613296c-0f95-4ea9-8259-a50551657f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:45.865655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613296c-0f95-4ea9-8259-a50551657f76 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:45.865939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613296c-0f95-4ea9-8259-a50551657f76 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:45.866292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613296c-0f95-4ea9-8259-a50551657f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:45.874883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613296c-0f95-4ea9-8259-a50551657f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:45.876650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613296c-0f95-4ea9-8259-a50551657f76 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:45.887413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 701/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:48.346145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f57d6-6388-458c-a3b5-85c0b61fe9c5 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:48.346799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f57d6-6388-458c-a3b5-85c0b61fe9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:48.346799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f57d6-6388-458c-a3b5-85c0b61fe9c5 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:48.348113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 691/1392] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:48.354035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0e24c-363b-45c4-bdb7-87ff37577266 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:48.354512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0e24c-363b-45c4-bdb7-87ff37577266 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:48.354700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0e24c-363b-45c4-bdb7-87ff37577266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:48.372211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-83e0e24c-363b-45c4-bdb7-87ff37577266 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:48.373517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-83e0e24c-363b-45c4-bdb7-87ff37577266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:48.381499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 702/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:48.426504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f57d6-6388-458c-a3b5-85c0b61fe9c5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:48.440731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f57d6-6388-458c-a3b5-85c0b61fe9c5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:48.446389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721db457-c9eb-4696-a6a6-3420e804a1b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:48.447030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db457-c9eb-4696-a6a6-3420e804a1b1 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:48.447343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db457-c9eb-4696-a6a6-3420e804a1b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:48.447655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db457-c9eb-4696-a6a6-3420e804a1b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:48.458358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db457-c9eb-4696-a6a6-3420e804a1b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:48.459960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db457-c9eb-4696-a6a6-3420e804a1b1 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:48.470378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 692/1394] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:49.907977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d968f4-837a-4d78-9669-e7c6e37ff43c None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:49.908549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d968f4-837a-4d78-9669-e7c6e37ff43c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:49.908656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d968f4-837a-4d78-9669-e7c6e37ff43c None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:49.910077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 703/1395] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:49.916083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908220-2daa-4ded-a6ea-988c79edb4c8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:49.916541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908220-2daa-4ded-a6ea-988c79edb4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:49.916768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908220-2daa-4ded-a6ea-988c79edb4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:49.922859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=52 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:49.934896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-23908220-2daa-4ded-a6ea-988c79edb4c8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:49.936644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-23908220-2daa-4ded-a6ea-988c79edb4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:49.943863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 693/1396] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:36:50.000219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36137b1-7575-4c26-8186-8d390a00a1f7 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:50.000517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36137b1-7575-4c26-8186-8d390a00a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:50.000804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36137b1-7575-4c26-8186-8d390a00a1f7 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:50.002197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 704/1397] 10.222.0.59 () {54 vars in 962 bytes} [Thu May 19 21:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:50.007368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fb680-19e6-4aa8-8ee7-c5475d71a0ba None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:50.008162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fb680-19e6-4aa8-8ee7-c5475d71a0ba None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:50.008445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fb680-19e6-4aa8-8ee7-c5475d71a0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:50.057122 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-698fb680-19e6-4aa8-8ee7-c5475d71a0ba None None] MFA Rules not processed for user `013746216dae469180f001d17ef6374e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:50.058324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-698fb680-19e6-4aa8-8ee7-c5475d71a0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:50.117226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 694/1398] 10.222.0.59 () {58 vars in 1059 bytes} [Thu May 19 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:50.124799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36137b1-7575-4c26-8186-8d390a00a1f7 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:50.135744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36137b1-7575-4c26-8186-8d390a00a1f7 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:50.139234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726d51e-68fc-4408-aec8-db6b8a1d399a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:50.139862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726d51e-68fc-4408-aec8-db6b8a1d399a service glance] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:50.140144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726d51e-68fc-4408-aec8-db6b8a1d399a service glance] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:50.140427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726d51e-68fc-4408-aec8-db6b8a1d399a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:50.149856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726d51e-68fc-4408-aec8-db6b8a1d399a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:50.151338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726d51e-68fc-4408-aec8-db6b8a1d399a service glance] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:50.160785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 705/1399] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:36:50.857351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea45918-1d83-4034-893e-8e4c430bb212 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:50.857351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea45918-1d83-4034-893e-8e4c430bb212 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:50.857351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea45918-1d83-4034-893e-8e4c430bb212 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:50.858586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 695/1400] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:50.864059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7163fe-d8a2-40bc-af4d-b22601e24aff None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:50.864354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7163fe-d8a2-40bc-af4d-b22601e24aff None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:50.864636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7163fe-d8a2-40bc-af4d-b22601e24aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:50.873861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48bef4-2679-4657-ae9e-e01994f2af3e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:50.874166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48bef4-2679-4657-ae9e-e01994f2af3e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:50.874501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48bef4-2679-4657-ae9e-e01994f2af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:50.883802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5f7163fe-d8a2-40bc-af4d-b22601e24aff None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:50.884984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5f7163fe-d8a2-40bc-af4d-b22601e24aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:50.893288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 706/1401] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:50.922931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-db48bef4-2679-4657-ae9e-e01994f2af3e None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:50.925963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-db48bef4-2679-4657-ae9e-e01994f2af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:50.937970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7163fe-d8a2-40bc-af4d-b22601e24aff None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:50.952167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7163fe-d8a2-40bc-af4d-b22601e24aff None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:50.958201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987ff38-260f-4fce-9d84-fc0179fd513c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:50.958927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ff38-260f-4fce-9d84-fc0179fd513c service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:50.959271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ff38-260f-4fce-9d84-fc0179fd513c service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:50.959604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ff38-260f-4fce-9d84-fc0179fd513c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:50.968368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ff38-260f-4fce-9d84-fc0179fd513c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:50.969942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ff38-260f-4fce-9d84-fc0179fd513c service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:50.979938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 707/1402] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:36:50.991986 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 696/1403] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:36:51.032969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5637d6-125e-4ada-bf65-6f27dda8d824 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:51.033287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5637d6-125e-4ada-bf65-6f27dda8d824 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:51.038542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5637d6-125e-4ada-bf65-6f27dda8d824 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:51.038542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 708/1404] 10.222.0.59 () {54 vars in 942 bytes} [Thu May 19 21:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:51.041118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006799c-4207-4777-bdfb-bc11dcee4df3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:51.041421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006799c-4207-4777-bdfb-bc11dcee4df3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:51.041697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006799c-4207-4777-bdfb-bc11dcee4df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:51.090888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8006799c-4207-4777-bdfb-bc11dcee4df3 None None] MFA Rules not processed for user `4af877878304440b9aa24964dedfadf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:51.092109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8006799c-4207-4777-bdfb-bc11dcee4df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:51.104976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:51.164310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 697/1405] 10.222.0.59 () {58 vars in 1039 bytes} [Thu May 19 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:51.174812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5637d6-125e-4ada-bf65-6f27dda8d824 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:51.189310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5637d6-125e-4ada-bf65-6f27dda8d824 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:51.195104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad556ad-ec0b-4f37-a4a0-14aa0039fbf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:51.195763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad556ad-ec0b-4f37-a4a0-14aa0039fbf1 service swift] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:51.196065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad556ad-ec0b-4f37-a4a0-14aa0039fbf1 service swift] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:51.196440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad556ad-ec0b-4f37-a4a0-14aa0039fbf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:51.206549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad556ad-ec0b-4f37-a4a0-14aa0039fbf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:51.208152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad556ad-ec0b-4f37-a4a0-14aa0039fbf1 service swift] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:51.217779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 709/1406] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:36:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:36:53.506316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40136-f6e0-4832-bb04-9a20c887f713 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:53.508668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40136-f6e0-4832-bb04-9a20c887f713 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:53.508668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40136-f6e0-4832-bb04-9a20c887f713 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:53.508856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 698/1407] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:36:53.517381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b50a4-dc32-47c7-8d04-ca43929a6af8 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:53.517932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b50a4-dc32-47c7-8d04-ca43929a6af8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:53.517932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b50a4-dc32-47c7-8d04-ca43929a6af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:53.538091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b48b50a4-dc32-47c7-8d04-ca43929a6af8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:36:53.539238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b48b50a4-dc32-47c7-8d04-ca43929a6af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:36:53.554164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 710/1408] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:36:53.606579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a40136-f6e0-4832-bb04-9a20c887f713 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:36:53.623094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a40136-f6e0-4832-bb04-9a20c887f713 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:36:53.629980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddf377-bc6e-4996-bff9-902e46ff8923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:36:53.630662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf377-bc6e-4996-bff9-902e46ff8923 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:36:53.630956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf377-bc6e-4996-bff9-902e46ff8923 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:36:53.631223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf377-bc6e-4996-bff9-902e46ff8923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:36:53.640749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddf377-bc6e-4996-bff9-902e46ff8923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:36:53.642438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddf377-bc6e-4996-bff9-902e46ff8923 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:36:53.654267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 699/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:03.532476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=48 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:03.913188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=30 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:15.927814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6b6d-bf8b-4708-aa35-ad8f7571e03a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:15.928448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6b6d-bf8b-4708-aa35-ad8f7571e03a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:15.928448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6b6d-bf8b-4708-aa35-ad8f7571e03a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:15.929756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 711/1410] 10.222.0.59 () {54 vars in 918 bytes} [Thu May 19 21:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:15.934807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff591d-59df-47dd-be86-e0c07f3f4467 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:15.935316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff591d-59df-47dd-be86-e0c07f3f4467 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:15.935417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff591d-59df-47dd-be86-e0c07f3f4467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:15.955616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-44ff591d-59df-47dd-be86-e0c07f3f4467 None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:15.957671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-44ff591d-59df-47dd-be86-e0c07f3f4467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:15.970911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 700/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Thu May 19 21:37:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:15.985583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc49c-33d1-45b3-acb4-cc32a6f52f75 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:15.985881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc49c-33d1-45b3-acb4-cc32a6f52f75 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:15.986173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc49c-33d1-45b3-acb4-cc32a6f52f75 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:15.987593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 712/1412] 10.222.0.59 () {54 vars in 918 bytes} [Thu May 19 21:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:15.991966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5134-27e0-41a7-a15b-8bb5d4375c2c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:15.992257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5134-27e0-41a7-a15b-8bb5d4375c2c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:15.992531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5134-27e0-41a7-a15b-8bb5d4375c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:16.010037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-178a5134-27e0-41a7-a15b-8bb5d4375c2c None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:16.011221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-178a5134-27e0-41a7-a15b-8bb5d4375c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:16.020007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 701/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Thu May 19 21:37:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:18.689628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aea07-364b-4d86-9495-9d2a9bc5df1e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:18.690160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aea07-364b-4d86-9495-9d2a9bc5df1e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:18.690160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aea07-364b-4d86-9495-9d2a9bc5df1e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:18.691565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:18.696771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31255d-c530-4ad4-8a2e-6156b0bfce4d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:18.697196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31255d-c530-4ad4-8a2e-6156b0bfce4d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:18.697331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31255d-c530-4ad4-8a2e-6156b0bfce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:18.715043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8f31255d-c530-4ad4-8a2e-6156b0bfce4d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:18.716221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8f31255d-c530-4ad4-8a2e-6156b0bfce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:18.723908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:18.766693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aea07-364b-4d86-9495-9d2a9bc5df1e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:18.780804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aea07-364b-4d86-9495-9d2a9bc5df1e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:18.786345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63d882-3f8d-4e3d-9170-1a8b9a1d55fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:18.786980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63d882-3f8d-4e3d-9170-1a8b9a1d55fb service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:18.787269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63d882-3f8d-4e3d-9170-1a8b9a1d55fb service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:18.787541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63d882-3f8d-4e3d-9170-1a8b9a1d55fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:18.796246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63d882-3f8d-4e3d-9170-1a8b9a1d55fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:18.797819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63d882-3f8d-4e3d-9170-1a8b9a1d55fb service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:18.807829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 714/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:19.788305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bf72-6d4e-4b52-b7f3-c40b7c819dae None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:19.788840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bf72-6d4e-4b52-b7f3-c40b7c819dae None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:19.788935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bf72-6d4e-4b52-b7f3-c40b7c819dae None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:19.790301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:19.795265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a066-37bd-4d91-92dd-03eada9b9dea None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:19.795703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a066-37bd-4d91-92dd-03eada9b9dea None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:19.795818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a066-37bd-4d91-92dd-03eada9b9dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:19.814229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fde4a066-37bd-4d91-92dd-03eada9b9dea None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:19.815434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fde4a066-37bd-4d91-92dd-03eada9b9dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:19.823671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:19.980724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79bf72-6d4e-4b52-b7f3-c40b7c819dae None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:19.997349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79bf72-6d4e-4b52-b7f3-c40b7c819dae None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:20.003421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763fb52-7561-4e16-aa5e-67cd29a94789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:20.004071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763fb52-7561-4e16-aa5e-67cd29a94789 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:20.004359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763fb52-7561-4e16-aa5e-67cd29a94789 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:20.004644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763fb52-7561-4e16-aa5e-67cd29a94789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:20.014024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763fb52-7561-4e16-aa5e-67cd29a94789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:20.015775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763fb52-7561-4e16-aa5e-67cd29a94789 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:20.025481 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 704/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:20.993191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa958-c5be-406a-a48d-789d79b8f3a4 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:20.993810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa958-c5be-406a-a48d-789d79b8f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:20.993810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa958-c5be-406a-a48d-789d79b8f3a4 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:20.995281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:21.000318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a93b5-fbb0-46c6-91eb-734845741fee None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:21.000743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a93b5-fbb0-46c6-91eb-734845741fee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:21.000881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a93b5-fbb0-46c6-91eb-734845741fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:21.019734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c18a93b5-fbb0-46c6-91eb-734845741fee None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:21.020912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c18a93b5-fbb0-46c6-91eb-734845741fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:21.029023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:21.180908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aa958-c5be-406a-a48d-789d79b8f3a4 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:21.195914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aa958-c5be-406a-a48d-789d79b8f3a4 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:21.201321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a7b8-ac5a-4dad-b131-f019197dbc15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:21.201954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a7b8-ac5a-4dad-b131-f019197dbc15 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:21.202260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a7b8-ac5a-4dad-b131-f019197dbc15 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:21.202540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a7b8-ac5a-4dad-b131-f019197dbc15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:21.210506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a7b8-ac5a-4dad-b131-f019197dbc15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:21.212084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a7b8-ac5a-4dad-b131-f019197dbc15 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:21.221293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 717/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:22.151865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed55f6-754f-419f-9e89-fa1bc8451078 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:22.152440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed55f6-754f-419f-9e89-fa1bc8451078 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:22.152440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed55f6-754f-419f-9e89-fa1bc8451078 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:22.153843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:22.158823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd87ec-f094-4065-b8d4-ff691b45b41d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:22.159229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd87ec-f094-4065-b8d4-ff691b45b41d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:22.159416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd87ec-f094-4065-b8d4-ff691b45b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:22.177200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9cdd87ec-f094-4065-b8d4-ff691b45b41d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:22.178903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9cdd87ec-f094-4065-b8d4-ff691b45b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:22.186731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:37:22.336076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed55f6-754f-419f-9e89-fa1bc8451078 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:22.349960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed55f6-754f-419f-9e89-fa1bc8451078 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:22.355731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b04f9e-e0d0-47d7-a375-fd6597374fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:22.356358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b04f9e-e0d0-47d7-a375-fd6597374fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:22.356638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b04f9e-e0d0-47d7-a375-fd6597374fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:22.356909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b04f9e-e0d0-47d7-a375-fd6597374fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:22.365081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b04f9e-e0d0-47d7-a375-fd6597374fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:22.367296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b04f9e-e0d0-47d7-a375-fd6597374fc3 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:22.376721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 707/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:23.295752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee958-91a3-4c6b-8ed5-2a5e1bc26781 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:23.297322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee958-91a3-4c6b-8ed5-2a5e1bc26781 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:23.297322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee958-91a3-4c6b-8ed5-2a5e1bc26781 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:23.297670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:23.302843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f8947-a0ac-4a73-b7e4-757945d01c81 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:23.303288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f8947-a0ac-4a73-b7e4-757945d01c81 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:23.303409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f8947-a0ac-4a73-b7e4-757945d01c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:23.321495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c07f8947-a0ac-4a73-b7e4-757945d01c81 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:23.322711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c07f8947-a0ac-4a73-b7e4-757945d01c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:23.330407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:23.483371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee958-91a3-4c6b-8ed5-2a5e1bc26781 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:23.497895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee958-91a3-4c6b-8ed5-2a5e1bc26781 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:23.503174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cea64-26d6-49f5-b9eb-8f90a82568d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:23.503799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cea64-26d6-49f5-b9eb-8f90a82568d8 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:23.504077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cea64-26d6-49f5-b9eb-8f90a82568d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:23.504352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cea64-26d6-49f5-b9eb-8f90a82568d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:23.512833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cea64-26d6-49f5-b9eb-8f90a82568d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:23.514438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cea64-26d6-49f5-b9eb-8f90a82568d8 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:23.523799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 720/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:24.449702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005ccc-e149-4b15-b963-6908abe677c4 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:24.450262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005ccc-e149-4b15-b963-6908abe677c4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:24.450262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005ccc-e149-4b15-b963-6908abe677c4 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:24.451655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:24.456505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783f09-146e-44e8-b668-91df816d20c9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:24.456926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783f09-146e-44e8-b668-91df816d20c9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:24.457065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783f09-146e-44e8-b668-91df816d20c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:24.474962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ca783f09-146e-44e8-b668-91df816d20c9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:24.476782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ca783f09-146e-44e8-b668-91df816d20c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:24.484445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:24.632387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005ccc-e149-4b15-b963-6908abe677c4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:24.646363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005ccc-e149-4b15-b963-6908abe677c4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:24.652091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a94bf7-e3dc-4823-9f45-fb7154a60ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:24.652717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94bf7-e3dc-4823-9f45-fb7154a60ca5 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:24.653001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94bf7-e3dc-4823-9f45-fb7154a60ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:24.653281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94bf7-e3dc-4823-9f45-fb7154a60ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:24.661143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a94bf7-e3dc-4823-9f45-fb7154a60ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:24.662773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a94bf7-e3dc-4823-9f45-fb7154a60ca5 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:24.671970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 710/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:25.641347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a44ff-6231-4561-bd59-b59d6f3c4759 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:25.641961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a44ff-6231-4561-bd59-b59d6f3c4759 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:25.641961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a44ff-6231-4561-bd59-b59d6f3c4759 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:25.643302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:25.648750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93942f9-1251-4f5d-9a27-a0599a0d5f88 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:25.649172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93942f9-1251-4f5d-9a27-a0599a0d5f88 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:25.649333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93942f9-1251-4f5d-9a27-a0599a0d5f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:25.666951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d93942f9-1251-4f5d-9a27-a0599a0d5f88 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:25.668132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d93942f9-1251-4f5d-9a27-a0599a0d5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:25.676090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:25.825655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a44ff-6231-4561-bd59-b59d6f3c4759 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:25.839733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a44ff-6231-4561-bd59-b59d6f3c4759 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:25.845287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac916b1-7910-4659-a892-f86352dc9816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:25.845912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac916b1-7910-4659-a892-f86352dc9816 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:25.846199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac916b1-7910-4659-a892-f86352dc9816 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:25.846492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac916b1-7910-4659-a892-f86352dc9816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:25.854411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac916b1-7910-4659-a892-f86352dc9816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:25.855982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac916b1-7910-4659-a892-f86352dc9816 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:25.865056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 723/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:26.833446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713afd26-683c-4644-b91e-fc1095de8421 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:26.833979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713afd26-683c-4644-b91e-fc1095de8421 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:26.833979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713afd26-683c-4644-b91e-fc1095de8421 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:26.835958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:26.840741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f27c-c6a3-499b-b369-caaa4bc7e336 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:26.841147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f27c-c6a3-499b-b369-caaa4bc7e336 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:26.841300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f27c-c6a3-499b-b369-caaa4bc7e336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:26.858907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4893f27c-c6a3-499b-b369-caaa4bc7e336 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:26.860077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4893f27c-c6a3-499b-b369-caaa4bc7e336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:26.867670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:27.016567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713afd26-683c-4644-b91e-fc1095de8421 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:27.031226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713afd26-683c-4644-b91e-fc1095de8421 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:27.036488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307582-cbd8-497d-9479-75fd5dc42231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:27.037111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307582-cbd8-497d-9479-75fd5dc42231 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:27.037415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307582-cbd8-497d-9479-75fd5dc42231 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:27.037740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307582-cbd8-497d-9479-75fd5dc42231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:27.045544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c307582-cbd8-497d-9479-75fd5dc42231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:27.047172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c307582-cbd8-497d-9479-75fd5dc42231 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:27.056533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 713/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:28.012831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60538964-884f-4b7d-a5c4-58c2c3887ce4 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:28.013410 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60538964-884f-4b7d-a5c4-58c2c3887ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:28.013410 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60538964-884f-4b7d-a5c4-58c2c3887ce4 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:28.014803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:28.019667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b453-e97d-4b66-99e9-1f9f23f1800e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:28.020065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b453-e97d-4b66-99e9-1f9f23f1800e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:28.020226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b453-e97d-4b66-99e9-1f9f23f1800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:28.039189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-43e7b453-e97d-4b66-99e9-1f9f23f1800e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:28.040376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-43e7b453-e97d-4b66-99e9-1f9f23f1800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:28.048323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:28.204161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60538964-884f-4b7d-a5c4-58c2c3887ce4 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:28.218719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60538964-884f-4b7d-a5c4-58c2c3887ce4 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:28.224074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cb0a1-3bd5-4df2-8a13-f3bc7d219ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:28.224705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cb0a1-3bd5-4df2-8a13-f3bc7d219ebf service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:28.225664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cb0a1-3bd5-4df2-8a13-f3bc7d219ebf service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:28.225930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cb0a1-3bd5-4df2-8a13-f3bc7d219ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:28.234364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cb0a1-3bd5-4df2-8a13-f3bc7d219ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:28.235954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cb0a1-3bd5-4df2-8a13-f3bc7d219ebf service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:28.245201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 726/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:30.338422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59680a-3dab-4b38-a025-a70ec9bea342 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:30.338958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59680a-3dab-4b38-a025-a70ec9bea342 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:30.338958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59680a-3dab-4b38-a025-a70ec9bea342 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:30.340399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:30.345689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765096b9-e1a0-4e6a-b0ff-bddab2159aa0 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:30.346104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765096b9-e1a0-4e6a-b0ff-bddab2159aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:30.346268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765096b9-e1a0-4e6a-b0ff-bddab2159aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:30.364510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-765096b9-e1a0-4e6a-b0ff-bddab2159aa0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:30.365714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-765096b9-e1a0-4e6a-b0ff-bddab2159aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:30.373906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:30.415941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59680a-3dab-4b38-a025-a70ec9bea342 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:30.431051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59680a-3dab-4b38-a025-a70ec9bea342 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:30.435279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75f053-2bd2-4bc8-b1f1-ba2390573a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:30.436202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f053-2bd2-4bc8-b1f1-ba2390573a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:30.436626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f053-2bd2-4bc8-b1f1-ba2390573a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:30.437038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f053-2bd2-4bc8-b1f1-ba2390573a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:30.449213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75f053-2bd2-4bc8-b1f1-ba2390573a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:30.451648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75f053-2bd2-4bc8-b1f1-ba2390573a0d service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:30.464444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 716/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:32.859240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee109f-41ee-4a9c-b3e3-2f7d126eb63a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:32.859830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee109f-41ee-4a9c-b3e3-2f7d126eb63a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:32.859830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee109f-41ee-4a9c-b3e3-2f7d126eb63a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:32.861155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:32.866471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5c13-1de8-4e82-b336-06a62779cc20 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:32.866899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5c13-1de8-4e82-b336-06a62779cc20 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:32.867042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5c13-1de8-4e82-b336-06a62779cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:32.884889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-40ce5c13-1de8-4e82-b336-06a62779cc20 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:32.886107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-40ce5c13-1de8-4e82-b336-06a62779cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:32.893762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:37:32.931701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee109f-41ee-4a9c-b3e3-2f7d126eb63a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:32.942192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee109f-41ee-4a9c-b3e3-2f7d126eb63a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:32.946184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88a43-9eb7-43b0-a099-8b3a6a93f96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:32.946839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88a43-9eb7-43b0-a099-8b3a6a93f96e service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:32.947146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88a43-9eb7-43b0-a099-8b3a6a93f96e service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:32.947422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88a43-9eb7-43b0-a099-8b3a6a93f96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:32.956112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d88a43-9eb7-43b0-a099-8b3a6a93f96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:32.957542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d88a43-9eb7-43b0-a099-8b3a6a93f96e service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:32.967354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 729/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:35.588172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f8903-19ed-48a4-a96e-7f968a73c8e1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:35.588731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f8903-19ed-48a4-a96e-7f968a73c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:35.588731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f8903-19ed-48a4-a96e-7f968a73c8e1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:35.590071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:35.595493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47acac-86eb-43c5-8b4f-7c9729e0c079 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:35.595934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47acac-86eb-43c5-8b4f-7c9729e0c079 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:35.596047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47acac-86eb-43c5-8b4f-7c9729e0c079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:35.613901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8b47acac-86eb-43c5-8b4f-7c9729e0c079 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:35.615142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8b47acac-86eb-43c5-8b4f-7c9729e0c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:35.622829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:35.660417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f8903-19ed-48a4-a96e-7f968a73c8e1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:35.671350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f8903-19ed-48a4-a96e-7f968a73c8e1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:35.675333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbc98b-c005-4f66-a430-ba6977a898a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:35.675968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc98b-c005-4f66-a430-ba6977a898a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:35.676253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc98b-c005-4f66-a430-ba6977a898a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:35.676532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc98b-c005-4f66-a430-ba6977a898a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:35.685551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbc98b-c005-4f66-a430-ba6977a898a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:35.687001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbc98b-c005-4f66-a430-ba6977a898a8 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:35.696674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 719/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:38.014725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6453a-ec7e-4ff7-a38d-3d3e84e0ea49 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:38.015300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6453a-ec7e-4ff7-a38d-3d3e84e0ea49 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:38.015300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6453a-ec7e-4ff7-a38d-3d3e84e0ea49 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:38.016663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:38.022722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98839828-18f1-414e-a509-0d80c9fe7417 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:38.023128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98839828-18f1-414e-a509-0d80c9fe7417 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:38.023282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98839828-18f1-414e-a509-0d80c9fe7417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:38.040750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-98839828-18f1-414e-a509-0d80c9fe7417 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:38.041952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-98839828-18f1-414e-a509-0d80c9fe7417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:38.050066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:38.089000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6453a-ec7e-4ff7-a38d-3d3e84e0ea49 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:38.099373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6453a-ec7e-4ff7-a38d-3d3e84e0ea49 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:38.102824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7444ac-4b5d-414f-a496-4554fc7b8b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:38.103442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7444ac-4b5d-414f-a496-4554fc7b8b95 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:38.103721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7444ac-4b5d-414f-a496-4554fc7b8b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:38.103991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7444ac-4b5d-414f-a496-4554fc7b8b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:38.112669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7444ac-4b5d-414f-a496-4554fc7b8b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:38.114117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7444ac-4b5d-414f-a496-4554fc7b8b95 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:38.123529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 732/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:40.388553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b347f-78de-405f-ab15-e3e361258f4b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:40.389107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b347f-78de-405f-ab15-e3e361258f4b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:40.389233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b347f-78de-405f-ab15-e3e361258f4b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:40.390578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:40.395778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3f5b-d7b9-4399-b13a-4afd4b53d762 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:40.396198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3f5b-d7b9-4399-b13a-4afd4b53d762 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:40.396376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3f5b-d7b9-4399-b13a-4afd4b53d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:40.414980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-42dc3f5b-d7b9-4399-b13a-4afd4b53d762 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:40.416165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-42dc3f5b-d7b9-4399-b13a-4afd4b53d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:40.424088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:40.462703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b347f-78de-405f-ab15-e3e361258f4b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:40.464462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a99b347f-78de-405f-ab15-e3e361258f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:40.477856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b347f-78de-405f-ab15-e3e361258f4b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:40.481379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119c3b-89a7-4c77-a2fb-9dd4299bc851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:40.482007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119c3b-89a7-4c77-a2fb-9dd4299bc851 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:40.482328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119c3b-89a7-4c77-a2fb-9dd4299bc851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:40.482608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119c3b-89a7-4c77-a2fb-9dd4299bc851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:40.492105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119c3b-89a7-4c77-a2fb-9dd4299bc851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:40.493544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119c3b-89a7-4c77-a2fb-9dd4299bc851 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:40.502904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 722/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:42.762262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec729738-0114-45b2-bbe1-b1aa5f467dbe None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:42.762839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec729738-0114-45b2-bbe1-b1aa5f467dbe None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:42.762839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec729738-0114-45b2-bbe1-b1aa5f467dbe None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:42.764200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:42.769698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4f329-f976-4398-b0e8-983a5150fc46 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:42.770080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4f329-f976-4398-b0e8-983a5150fc46 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:42.770300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4f329-f976-4398-b0e8-983a5150fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:42.788036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-feb4f329-f976-4398-b0e8-983a5150fc46 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:42.789208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-feb4f329-f976-4398-b0e8-983a5150fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:42.796741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:42.837274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec729738-0114-45b2-bbe1-b1aa5f467dbe None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:42.848661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec729738-0114-45b2-bbe1-b1aa5f467dbe None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:42.852088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa16ec5-c0d3-4da4-87ce-2dd740022bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:42.852716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16ec5-c0d3-4da4-87ce-2dd740022bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:42.852999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16ec5-c0d3-4da4-87ce-2dd740022bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:42.853278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16ec5-c0d3-4da4-87ce-2dd740022bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:42.862599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16ec5-c0d3-4da4-87ce-2dd740022bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:42.864046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16ec5-c0d3-4da4-87ce-2dd740022bfe service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:42.874244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 735/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:45.198878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb92d8-303e-4a6e-8f84-da9b76914f5d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:45.199536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb92d8-303e-4a6e-8f84-da9b76914f5d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:45.199536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb92d8-303e-4a6e-8f84-da9b76914f5d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:45.200845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:45.206443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ecbb9-23bc-4ee9-8171-9f1dd88725e4 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:45.206892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ecbb9-23bc-4ee9-8171-9f1dd88725e4 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:45.207050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ecbb9-23bc-4ee9-8171-9f1dd88725e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:45.213231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=70 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:45.225118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9a8ecbb9-23bc-4ee9-8171-9f1dd88725e4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:45.226354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9a8ecbb9-23bc-4ee9-8171-9f1dd88725e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:45.234121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:45.276737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb92d8-303e-4a6e-8f84-da9b76914f5d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:45.282146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=73 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:45.287750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb92d8-303e-4a6e-8f84-da9b76914f5d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:45.291354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af919b9c-6547-4a16-bdb3-3f6c8728ecc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:45.292683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af919b9c-6547-4a16-bdb3-3f6c8728ecc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:45.292683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af919b9c-6547-4a16-bdb3-3f6c8728ecc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:45.292683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af919b9c-6547-4a16-bdb3-3f6c8728ecc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:45.303341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af919b9c-6547-4a16-bdb3-3f6c8728ecc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:45.304839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af919b9c-6547-4a16-bdb3-3f6c8728ecc0 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:45.314278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 725/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:47.588326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429b5ad-1ebb-45d9-a0b7-e0e9aa42b9ea None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:47.588938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429b5ad-1ebb-45d9-a0b7-e0e9aa42b9ea None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:47.588938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429b5ad-1ebb-45d9-a0b7-e0e9aa42b9ea None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:47.590197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:47.596587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adeff3-593f-4c1a-bb62-0467b849926c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:47.597076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adeff3-593f-4c1a-bb62-0467b849926c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:47.597263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adeff3-593f-4c1a-bb62-0467b849926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:47.615471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-49adeff3-593f-4c1a-bb62-0467b849926c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:47.616655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-49adeff3-593f-4c1a-bb62-0467b849926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:47.624455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:47.663731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429b5ad-1ebb-45d9-a0b7-e0e9aa42b9ea None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:47.674443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429b5ad-1ebb-45d9-a0b7-e0e9aa42b9ea None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:47.677852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc097a-d9b7-41cc-9352-22e16eb19b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:47.678508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc097a-d9b7-41cc-9352-22e16eb19b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:47.678791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc097a-d9b7-41cc-9352-22e16eb19b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:47.679063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc097a-d9b7-41cc-9352-22e16eb19b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:47.687626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc097a-d9b7-41cc-9352-22e16eb19b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:47.689042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc097a-d9b7-41cc-9352-22e16eb19b07 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:47.698116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 738/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:49.907206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9851-590f-4922-afa0-8679c52313d8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:49.907749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9851-590f-4922-afa0-8679c52313d8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:49.907749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9851-590f-4922-afa0-8679c52313d8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:49.909162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:49.914504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb13df-9d0b-4fbe-bef5-2b6d5e667ba9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:49.914944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb13df-9d0b-4fbe-bef5-2b6d5e667ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:49.915057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb13df-9d0b-4fbe-bef5-2b6d5e667ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:49.933063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-27bb13df-9d0b-4fbe-bef5-2b6d5e667ba9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:49.934267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-27bb13df-9d0b-4fbe-bef5-2b6d5e667ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:49.943318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:49.986395 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9851-590f-4922-afa0-8679c52313d8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:49.997541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9851-590f-4922-afa0-8679c52313d8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:50.001008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae5519-d996-421d-8195-5f009bc19a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:50.001636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5519-d996-421d-8195-5f009bc19a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:50.001917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5519-d996-421d-8195-5f009bc19a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:50.002193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5519-d996-421d-8195-5f009bc19a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:50.011602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae5519-d996-421d-8195-5f009bc19a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:50.013032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae5519-d996-421d-8195-5f009bc19a1c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:50.022324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 728/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:37:52.221960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0563d-0a25-4822-bd7a-b7cc049c7583 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:52.222576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0563d-0a25-4822-bd7a-b7cc049c7583 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:52.222576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0563d-0a25-4822-bd7a-b7cc049c7583 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:52.223941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:37:52.229301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e46ed-619e-4d6c-8bb2-c36474f97178 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:52.229759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e46ed-619e-4d6c-8bb2-c36474f97178 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:52.229865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e46ed-619e-4d6c-8bb2-c36474f97178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:52.247767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-204e46ed-619e-4d6c-8bb2-c36474f97178 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:37:52.248963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-204e46ed-619e-4d6c-8bb2-c36474f97178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:37:52.257464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:37:52.293961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0563d-0a25-4822-bd7a-b7cc049c7583 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:37:52.305552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0563d-0a25-4822-bd7a-b7cc049c7583 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:37:52.309110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502dcf2-bf94-43ee-a23e-a97dd6c3c915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:37:52.309771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502dcf2-bf94-43ee-a23e-a97dd6c3c915 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:37:52.310056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502dcf2-bf94-43ee-a23e-a97dd6c3c915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:37:52.310379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502dcf2-bf94-43ee-a23e-a97dd6c3c915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:37:52.323201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502dcf2-bf94-43ee-a23e-a97dd6c3c915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:37:52.324688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502dcf2-bf94-43ee-a23e-a97dd6c3c915 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:37:52.334720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 741/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:38:02.242781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=17 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:02.330136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=17 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:25.685934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4ae8d-d5d0-4ff6-a34a-0d35a6c2110f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:25.686553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4ae8d-d5d0-4ff6-a34a-0d35a6c2110f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:25.686553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4ae8d-d5d0-4ff6-a34a-0d35a6c2110f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:25.687936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 730/1471] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:38:25.693095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d9ffd-4481-4661-997c-a3a5f0501693 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:25.693525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d9ffd-4481-4661-997c-a3a5f0501693 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:25.693692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d9ffd-4481-4661-997c-a3a5f0501693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:25.711462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b83d9ffd-4481-4661-997c-a3a5f0501693 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:25.712637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b83d9ffd-4481-4661-997c-a3a5f0501693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:25.720347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 742/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:25.766469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199324e-a3e9-444c-b6dc-1a3c0f09150f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:25.766763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199324e-a3e9-444c-b6dc-1a3c0f09150f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:25.767042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199324e-a3e9-444c-b6dc-1a3c0f09150f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:25.768416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 731/1473] 10.222.0.59 () {54 vars in 962 bytes} [Thu May 19 21:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:38:25.773736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187ad0-aaa2-4ed5-8e37-372f4de2f84f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:25.774026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187ad0-aaa2-4ed5-8e37-372f4de2f84f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:25.774332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187ad0-aaa2-4ed5-8e37-372f4de2f84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:25.793440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4b187ad0-aaa2-4ed5-8e37-372f4de2f84f None None] MFA Rules not processed for user `013746216dae469180f001d17ef6374e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:25.794667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4b187ad0-aaa2-4ed5-8e37-372f4de2f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:25.801319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 743/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Thu May 19 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:25.812414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199324e-a3e9-444c-b6dc-1a3c0f09150f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:38:25.827425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199324e-a3e9-444c-b6dc-1a3c0f09150f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:38:25.832464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b5fe4-934c-40c5-8094-e3033a11d1c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:38:25.833103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b5fe4-934c-40c5-8094-e3033a11d1c8 service glance] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:25.833387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b5fe4-934c-40c5-8094-e3033a11d1c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:25.833664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b5fe4-934c-40c5-8094-e3033a11d1c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:25.842596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b5fe4-934c-40c5-8094-e3033a11d1c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:38:25.844087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b5fe4-934c-40c5-8094-e3033a11d1c8 service glance] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:38:25.854123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 732/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:38:28.164098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210cbc-e505-4837-a5fb-50dd2544c8e8 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:28.164671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210cbc-e505-4837-a5fb-50dd2544c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:28.164671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210cbc-e505-4837-a5fb-50dd2544c8e8 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:28.166041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 744/1476] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:38:28.171471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161210c3-26ee-460b-a448-6607977a7955 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:28.171919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161210c3-26ee-460b-a448-6607977a7955 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:28.172015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161210c3-26ee-460b-a448-6607977a7955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:28.189672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-161210c3-26ee-460b-a448-6607977a7955 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:28.196889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-161210c3-26ee-460b-a448-6607977a7955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:28.199750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 733/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:28.223322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48210cbc-e505-4837-a5fb-50dd2544c8e8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:38:28.236035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48210cbc-e505-4837-a5fb-50dd2544c8e8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:38:28.240461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf5866-1717-49fc-ac2f-9bc33a62a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:38:28.241101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5866-1717-49fc-ac2f-9bc33a62a01d admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:28.241388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5866-1717-49fc-ac2f-9bc33a62a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:28.241656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5866-1717-49fc-ac2f-9bc33a62a01d admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:28.242416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf5866-1717-49fc-ac2f-9bc33a62a01d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:38:28.244209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-e6bf5866-1717-49fc-ac2f-9bc33a62a01d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:38:28.244209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:38:28.244209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:38:28.245329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf5866-1717-49fc-ac2f-9bc33a62a01d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:38:28.265157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 745/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 19 21:38:28 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:38:30.488876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aa3a8-3d1e-42a2-9853-044bb9146c0a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:30.489443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aa3a8-3d1e-42a2-9853-044bb9146c0a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:30.489443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aa3a8-3d1e-42a2-9853-044bb9146c0a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:30.490859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 734/1479] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:38:30.496231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e8f2-5469-488d-aeb6-5fcbf32b76a4 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:30.496689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e8f2-5469-488d-aeb6-5fcbf32b76a4 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:30.496795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e8f2-5469-488d-aeb6-5fcbf32b76a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:30.515337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a932e8f2-5469-488d-aeb6-5fcbf32b76a4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:30.516545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a932e8f2-5469-488d-aeb6-5fcbf32b76a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:30.524469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 746/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:30.568209 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aa3a8-3d1e-42a2-9853-044bb9146c0a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:38:30.582264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aa3a8-3d1e-42a2-9853-044bb9146c0a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:38:30.587521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8e5db-e2fa-4964-b385-b263f7a39bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:38:30.588147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e5db-e2fa-4964-b385-b263f7a39bfe service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:30.588431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e5db-e2fa-4964-b385-b263f7a39bfe service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:30.588709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e5db-e2fa-4964-b385-b263f7a39bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:30.597651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8e5db-e2fa-4964-b385-b263f7a39bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:38:30.599277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8e5db-e2fa-4964-b385-b263f7a39bfe service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:38:30.608713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 735/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:38:32.982597 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac78b-f255-426c-ad1d-d798a9d6b9d8 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:32.983169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac78b-f255-426c-ad1d-d798a9d6b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:32.983169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac78b-f255-426c-ad1d-d798a9d6b9d8 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:32.984554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 747/1482] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:38:32.990453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557212-8cc4-4835-80fa-bb7a4393f55d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:32.990858 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557212-8cc4-4835-80fa-bb7a4393f55d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:32.991014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557212-8cc4-4835-80fa-bb7a4393f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:33.008529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-77557212-8cc4-4835-80fa-bb7a4393f55d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:33.009700 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-77557212-8cc4-4835-80fa-bb7a4393f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:33.017330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 736/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:33.053139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac78b-f255-426c-ad1d-d798a9d6b9d8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:38:33.063690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac78b-f255-426c-ad1d-d798a9d6b9d8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:38:33.067165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49304908-bdb7-41ba-82aa-cd297abf5f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:38:33.067791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49304908-bdb7-41ba-82aa-cd297abf5f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:33.068072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49304908-bdb7-41ba-82aa-cd297abf5f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:33.068351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49304908-bdb7-41ba-82aa-cd297abf5f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:33.076916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49304908-bdb7-41ba-82aa-cd297abf5f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:38:33.078387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49304908-bdb7-41ba-82aa-cd297abf5f6a service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:38:33.087515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 748/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:38:35.348482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe69eb-4e84-4f74-bd23-32549ff6c08a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:35.348997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe69eb-4e84-4f74-bd23-32549ff6c08a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:35.349090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe69eb-4e84-4f74-bd23-32549ff6c08a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:35.350466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 737/1485] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:38:35.355709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0e0c-f8d6-4959-9d92-d90bf9d139ce None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:35.356108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0e0c-f8d6-4959-9d92-d90bf9d139ce None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:35.356279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0e0c-f8d6-4959-9d92-d90bf9d139ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:35.374062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9f9f0e0c-f8d6-4959-9d92-d90bf9d139ce None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:35.375272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9f9f0e0c-f8d6-4959-9d92-d90bf9d139ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:35.383017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 749/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:35.420265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe69eb-4e84-4f74-bd23-32549ff6c08a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:38:35.431288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe69eb-4e84-4f74-bd23-32549ff6c08a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:38:35.434768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5863e8-4eb4-41b1-970e-7e91b92bc675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:38:35.435401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5863e8-4eb4-41b1-970e-7e91b92bc675 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:35.435688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5863e8-4eb4-41b1-970e-7e91b92bc675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:35.435963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5863e8-4eb4-41b1-970e-7e91b92bc675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:35.444638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5863e8-4eb4-41b1-970e-7e91b92bc675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:38:35.446067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5863e8-4eb4-41b1-970e-7e91b92bc675 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:38:35.455250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 738/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:38:37.787299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7117f2-27fd-480a-9b1c-4a6103c0f64a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:37.787905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7117f2-27fd-480a-9b1c-4a6103c0f64a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:37.787905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7117f2-27fd-480a-9b1c-4a6103c0f64a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:37.789227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 750/1488] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:38:37.794532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4e1f0-2e97-4e80-b0b0-7b0d43adce7a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:37.794967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4e1f0-2e97-4e80-b0b0-7b0d43adce7a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:37.795128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4e1f0-2e97-4e80-b0b0-7b0d43adce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:37.812664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dda4e1f0-2e97-4e80-b0b0-7b0d43adce7a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:37.813848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dda4e1f0-2e97-4e80-b0b0-7b0d43adce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:37.821673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 739/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:37.861289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7117f2-27fd-480a-9b1c-4a6103c0f64a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:38:37.872494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7117f2-27fd-480a-9b1c-4a6103c0f64a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:38:37.875983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5c94-aee2-4819-a4a2-db5ca42bfc9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:38:37.876612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5c94-aee2-4819-a4a2-db5ca42bfc9d service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:37.876918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5c94-aee2-4819-a4a2-db5ca42bfc9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:37.877197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5c94-aee2-4819-a4a2-db5ca42bfc9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:37.885982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5c94-aee2-4819-a4a2-db5ca42bfc9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:38:37.887538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5c94-aee2-4819-a4a2-db5ca42bfc9d service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:38:37.897201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 751/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:38:40.545724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21748447-cd6d-4534-89f2-c4e0d1ba7b4b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:40.546459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21748447-cd6d-4534-89f2-c4e0d1ba7b4b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:40.546577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21748447-cd6d-4534-89f2-c4e0d1ba7b4b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:40.547982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 740/1491] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 19 21:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:38:40.553304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691427af-4fe6-4514-af7a-c0118723b58b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:40.553707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691427af-4fe6-4514-af7a-c0118723b58b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:40.553869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691427af-4fe6-4514-af7a-c0118723b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:40.571759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-691427af-4fe6-4514-af7a-c0118723b58b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:38:40.572945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-691427af-4fe6-4514-af7a-c0118723b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:38:40.581635 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 752/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 19 21:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:38:40.618901 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21748447-cd6d-4534-89f2-c4e0d1ba7b4b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:38:40.630282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21748447-cd6d-4534-89f2-c4e0d1ba7b4b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:38:40.633743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ac66f-ab2a-4ba4-a3cd-7f5b71a11589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:38:40.634407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ac66f-ab2a-4ba4-a3cd-7f5b71a11589 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:38:40.634693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ac66f-ab2a-4ba4-a3cd-7f5b71a11589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:38:40.634968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ac66f-ab2a-4ba4-a3cd-7f5b71a11589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:38:40.644595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ac66f-ab2a-4ba4-a3cd-7f5b71a11589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:38:40.646068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ac66f-ab2a-4ba4-a3cd-7f5b71a11589 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:38:40.660114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 741/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:38:50.566607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=33 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:50.653924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=33 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:29.791753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ba57-fe90-420c-8ae8-0840991c30b5 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:29.800829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ba57-fe90-420c-8ae8-0840991c30b5 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:29.800829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ba57-fe90-420c-8ae8-0840991c30b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:29.810338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-cf60ba57-fe90-420c-8ae8-0840991c30b5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:40:29.811534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cf60ba57-fe90-420c-8ae8-0840991c30b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:40:29.819349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 753/1494] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:40:29.829233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bfea-8f2a-4054-81bc-c28203c1d67f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:29.829789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bfea-8f2a-4054-81bc-c28203c1d67f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:29.829789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bfea-8f2a-4054-81bc-c28203c1d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:29.848752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ea26bfea-8f2a-4054-81bc-c28203c1d67f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:40:29.850011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ea26bfea-8f2a-4054-81bc-c28203c1d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:40:29.857806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 742/1495] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:40:29.862475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ba57-fe90-420c-8ae8-0840991c30b5 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:29.872126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ba57-fe90-420c-8ae8-0840991c30b5 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:29.876662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:29.877310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:29.877598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:29.877879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:29.878639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:40:29.878946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:29.879956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:29.879956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:40:29.879956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:40:29.880832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:29.892758 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 754/1496] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:40:29.900728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26bfea-8f2a-4054-81bc-c28203c1d67f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:29.910737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26bfea-8f2a-4054-81bc-c28203c1d67f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:29.915351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:29.915998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:29.916280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:29.916555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:29.917260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:29.919326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:29.919326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: warnings.warn(msg) May 19 21:40:29.919326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: May 19 21:40:29.920529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:30.023342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 743/1497] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:40:29 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:40:30.027503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:30.037892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714689-8394-486c-b993-06c5d4a81b5c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:30.091717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:30.092966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.093255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.093533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.094245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:30.095281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:30.095281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:40:30.095281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:40:30.096474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:30.164067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 755/1498] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:40:30 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:40:30.168443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:30.178819 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602e5b1-91d7-45fd-bdef-ecd8a38b0a48 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:30.183347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:30.183999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.184286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.184562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.185277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:30.186834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:30.186834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: warnings.warn(msg) May 19 21:40:30.186834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: May 19 21:40:30.191863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:30.200377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 744/1499] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:40:30.205166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:30.214885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0b86-4b91-4f45-b8da-e8da75cb7878 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:30.219372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61237ca-6e87-4987-9e21-1fb26ba1f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:30.220375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61237ca-6e87-4987-9e21-1fb26ba1f79d admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.220375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61237ca-6e87-4987-9e21-1fb26ba1f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.220566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61237ca-6e87-4987-9e21-1fb26ba1f79d admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.221243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61237ca-6e87-4987-9e21-1fb26ba1f79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:30.222354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-f61237ca-6e87-4987-9e21-1fb26ba1f79d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:30.222354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:40:30.222354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:40:30.223226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61237ca-6e87-4987-9e21-1fb26ba1f79d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:30.236210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 756/1500] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:40:30.240218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:30.250757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652330-78d9-400e-9c32-7b456e676882 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:30.255271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8c24b-ecee-462c-a433-731e0077ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:30.256142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8c24b-ecee-462c-a433-731e0077ae78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.256421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8c24b-ecee-462c-a433-731e0077ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.256694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8c24b-ecee-462c-a433-731e0077ae78 admin admin] PATH_INFO: `/v3/projects/8017969aab0640e1a005eb8fe5f868b3/users/5e7f695eca1b451eb1034cd1efc94cd5/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.271803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8c24b-ecee-462c-a433-731e0077ae78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8017969aab0640e1a005eb8fe5f868b3, user_id=5e7f695eca1b451eb1034cd1efc94cd5, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:30.272833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-43c8c24b-ecee-462c-a433-731e0077ae78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:30.272833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: warnings.warn(msg) May 19 21:40:30.272833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: May 19 21:40:30.274785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8c24b-ecee-462c-a433-731e0077ae78 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:30.361676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 745/1501] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:40:30 2022] PUT /identity/v3/projects/8017969aab0640e1a005eb8fe5f868b3/users/5e7f695eca1b451eb1034cd1efc94cd5/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:40:30.372885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a91a3-28d8-4812-9e2e-0f276ee3c815 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.373185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a91a3-28d8-4812-9e2e-0f276ee3c815 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.374106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a91a3-28d8-4812-9e2e-0f276ee3c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.399968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-255a91a3-28d8-4812-9e2e-0f276ee3c815 None None] MFA Rules not processed for user `5e7f695eca1b451eb1034cd1efc94cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:40:30.401177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-255a91a3-28d8-4812-9e2e-0f276ee3c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:40:30.462968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 757/1502] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:40:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:40:30.475998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08a26-2fd9-48ae-8df7-7c08391c5f2e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.476293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08a26-2fd9-48ae-8df7-7c08391c5f2e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.476572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08a26-2fd9-48ae-8df7-7c08391c5f2e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.477936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 746/1503] 10.222.0.59 () {54 vars in 963 bytes} [Thu May 19 21:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:40:30.482771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78daf5-a7ec-43ff-87f1-58cf2c2a4732 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.483074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78daf5-a7ec-43ff-87f1-58cf2c2a4732 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.483353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78daf5-a7ec-43ff-87f1-58cf2c2a4732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.501138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1b78daf5-a7ec-43ff-87f1-58cf2c2a4732 None None] MFA Rules not processed for user `65573e15809c42a98cc3e603355df832`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:40:30.502347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1b78daf5-a7ec-43ff-87f1-58cf2c2a4732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:40:30.545200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:30.552618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 758/1504] 10.222.0.59 () {58 vars in 1060 bytes} [Thu May 19 21:40:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:40:30.560373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08a26-2fd9-48ae-8df7-7c08391c5f2e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:30.571443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08a26-2fd9-48ae-8df7-7c08391c5f2e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:30.574968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:30.575590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.575869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.576139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.584596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:30.585995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:30.594881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 747/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:40:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:40:30.643809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abe35-82c5-4bcc-ae9b-422cd2e950c6 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.644100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abe35-82c5-4bcc-ae9b-422cd2e950c6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.644392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abe35-82c5-4bcc-ae9b-422cd2e950c6 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.645862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 759/1506] 10.222.0.59 () {52 vars in 829 bytes} [Thu May 19 21:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:40:30.649461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:30.710226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54994f9e-102c-47e1-92ff-6d08f1a69941 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:30.714648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:30.715523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:30.715791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:30.716067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] PATH_INFO: `/v3/users/5e7f695eca1b451eb1034cd1efc94cd5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:30.717228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7f695eca1b451eb1034cd1efc94cd5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:30.718265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:30.718265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: warnings.warn(msg) May 19 21:40:30.718265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: May 19 21:40:30.719471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:30.916799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7f695eca1b451eb1034cd1efc94cd5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:30.929788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7f695eca1b451eb1034cd1efc94cd5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:30.996056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7f695eca1b451eb1034cd1efc94cd5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.012734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:31.015200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7f695eca1b451eb1034cd1efc94cd5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.015879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7f695eca1b451eb1034cd1efc94cd5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.021803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 748/1507] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:40:30 2022] DELETE /identity/v3/users/5e7f695eca1b451eb1034cd1efc94cd5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:40:31.026400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:31.026878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:31.026985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:31.047512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:40:31.048694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:40:31.105729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 760/1508] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:40:31.115954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:31.117494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:40:31.174983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01b37e-4126-454e-94e7-4d622cc2a8b2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:31.178506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f26aa4-4f96-472f-8351-2379038a44f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:31.179148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f26aa4-4f96-472f-8351-2379038a44f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:31.179436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f26aa4-4f96-472f-8351-2379038a44f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:31.179717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f26aa4-4f96-472f-8351-2379038a44f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:31.188544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f26aa4-4f96-472f-8351-2379038a44f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:31.189979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f26aa4-4f96-472f-8351-2379038a44f2 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:31.199464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 749/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:40:31.666488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:40:31.668156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:40:31.682985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86e56e-3efa-4dcf-b028-e25c21c1f5f8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:40:31.685023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:40:31.686408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:40:31.686690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:40:31.686963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] PATH_INFO: `/v3/projects/8017969aab0640e1a005eb8fe5f868b3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:40:31.688133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8017969aab0640e1a005eb8fe5f868b3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:40:31.689250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:40:31.689250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:40:31.689250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:40:31.690494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:40:31.846368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8017969aab0640e1a005eb8fe5f868b3', 'request_id': 'req-e448d5f4-83f2-4acf-aa29-088e23928f4b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.852246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8017969aab0640e1a005eb8fe5f868b3', 'request_id': 'req-e448d5f4-83f2-4acf-aa29-088e23928f4b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.921187 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8017969aab0640e1a005eb8fe5f868b3', 'request_id': 'req-e448d5f4-83f2-4acf-aa29-088e23928f4b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.939914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] The token cache is being invalidate because project 8017969aab0640e1a005eb8fe5f868b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:40:31.940141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.940852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e448d5f4-83f2-4acf-aa29-088e23928f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:40:31.942407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 761/1510] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:40:31 2022] DELETE /identity/v3/projects/8017969aab0640e1a005eb8fe5f868b3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:40:41.195202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:41.936989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:15.983411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a6e3-225d-43d9-9794-d279dfb34e60 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:15.984036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a6e3-225d-43d9-9794-d279dfb34e60 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:15.984036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a6e3-225d-43d9-9794-d279dfb34e60 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:15.985354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:15.990703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c391f-caa7-41d6-b637-16609746cf89 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:15.991108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c391f-caa7-41d6-b637-16609746cf89 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:15.991264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c391f-caa7-41d6-b637-16609746cf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:16.009062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c05c391f-caa7-41d6-b637-16609746cf89 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:16.010285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c05c391f-caa7-41d6-b637-16609746cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:16.067227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:16.235345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9a6e3-225d-43d9-9794-d279dfb34e60 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:16.237194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-20f9a6e3-225d-43d9-9794-d279dfb34e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:16.312314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9a6e3-225d-43d9-9794-d279dfb34e60 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:16.317794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d800ce-755d-48ff-b293-23345ef761ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:16.318566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d800ce-755d-48ff-b293-23345ef761ab service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:16.318855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d800ce-755d-48ff-b293-23345ef761ab service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:16.319137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d800ce-755d-48ff-b293-23345ef761ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:16.327338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d800ce-755d-48ff-b293-23345ef761ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:16.328969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d800ce-755d-48ff-b293-23345ef761ab service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:16.338712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 751/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:16.903019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624110-3ddd-4595-9184-8027d3ac13ec None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:16.903229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624110-3ddd-4595-9184-8027d3ac13ec None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:16.903495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624110-3ddd-4595-9184-8027d3ac13ec None None] PATH_INFO: `/v3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:16.904848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 763/1514] 10.222.0.97 () {54 vars in 925 bytes} [Thu May 19 21:42:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:42:16.910879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949b63b-4ee7-4e3c-bbee-659364a34a18 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:16.911245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949b63b-4ee7-4e3c-bbee-659364a34a18 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:16.911603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949b63b-4ee7-4e3c-bbee-659364a34a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:16.933255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e949b63b-4ee7-4e3c-bbee-659364a34a18 None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:16.934516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e949b63b-4ee7-4e3c-bbee-659364a34a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:17.005183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 752/1515] 10.222.0.97 () {58 vars in 1015 bytes} [Thu May 19 21:42:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:17.266669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194c40-5ebb-4790-ac8e-ee8e53cb4aa2 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:17.267252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194c40-5ebb-4790-ac8e-ee8e53cb4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:17.267252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194c40-5ebb-4790-ac8e-ee8e53cb4aa2 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:17.268520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 764/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:17.273421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1930455-c622-4294-83cb-143df495be35 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:17.273754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1930455-c622-4294-83cb-143df495be35 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:17.274033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1930455-c622-4294-83cb-143df495be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:17.292975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d1930455-c622-4294-83cb-143df495be35 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:17.294169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1930455-c622-4294-83cb-143df495be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:17.302711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 753/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:17.450598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194c40-5ebb-4790-ac8e-ee8e53cb4aa2 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:17.464835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194c40-5ebb-4790-ac8e-ee8e53cb4aa2 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:17.470114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c34ea-d61d-43ff-a959-f5a5ae26acb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:17.471319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c34ea-d61d-43ff-a959-f5a5ae26acb8 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:17.471602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c34ea-d61d-43ff-a959-f5a5ae26acb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:17.471878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c34ea-d61d-43ff-a959-f5a5ae26acb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:17.480210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c34ea-d61d-43ff-a959-f5a5ae26acb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:17.481896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c34ea-d61d-43ff-a959-f5a5ae26acb8 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:17.491864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 765/1518] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:21.031219 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe722c-d372-4ae0-b869-e9cb109325e9 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:21.031673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe722c-d372-4ae0-b869-e9cb109325e9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:21.031807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe722c-d372-4ae0-b869-e9cb109325e9 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:21.033194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 754/1519] 10.222.0.59 () {54 vars in 960 bytes} [Thu May 19 21:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:21.038611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dc406-2646-495f-a201-45a1c4b6db62 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:21.039258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dc406-2646-495f-a201-45a1c4b6db62 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:21.039431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dc406-2646-495f-a201-45a1c4b6db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:21.057580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5b9dc406-2646-495f-a201-45a1c4b6db62 None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:21.058812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5b9dc406-2646-495f-a201-45a1c4b6db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:21.067189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 766/1520] 10.222.0.59 () {58 vars in 1057 bytes} [Thu May 19 21:42:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:21.074436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe722c-d372-4ae0-b869-e9cb109325e9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:21.087619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe722c-d372-4ae0-b869-e9cb109325e9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:21.092594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8543d3-686b-4a56-a2b0-74093685bf0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:21.093234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8543d3-686b-4a56-a2b0-74093685bf0f service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:21.093520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8543d3-686b-4a56-a2b0-74093685bf0f service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:21.093797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8543d3-686b-4a56-a2b0-74093685bf0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:21.102718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8543d3-686b-4a56-a2b0-74093685bf0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:21.104322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8543d3-686b-4a56-a2b0-74093685bf0f service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:21.114438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 755/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:42:28.808995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37479f-31e1-46eb-9f46-efd3a935fb67 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:28.809575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37479f-31e1-46eb-9f46-efd3a935fb67 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:28.809575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37479f-31e1-46eb-9f46-efd3a935fb67 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:28.810988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:28.815670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ba39-cee5-450d-a5dd-6e8e2473143d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:28.816079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ba39-cee5-450d-a5dd-6e8e2473143d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:28.816220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ba39-cee5-450d-a5dd-6e8e2473143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:28.834450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-aee3ba39-cee5-450d-a5dd-6e8e2473143d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:28.835631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-aee3ba39-cee5-450d-a5dd-6e8e2473143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:28.843281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:28.995836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37479f-31e1-46eb-9f46-efd3a935fb67 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:29.009984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37479f-31e1-46eb-9f46-efd3a935fb67 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:29.015361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b788-718c-45f0-accd-bee4428c8108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:29.016022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b788-718c-45f0-accd-bee4428c8108 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:29.016306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b788-718c-45f0-accd-bee4428c8108 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:29.016588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b788-718c-45f0-accd-bee4428c8108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:29.025084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b788-718c-45f0-accd-bee4428c8108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:29.026706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b788-718c-45f0-accd-bee4428c8108 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:29.036659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 768/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:29.918928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959002-2265-4ea1-891b-093ca4524fdf None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:29.919380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959002-2265-4ea1-891b-093ca4524fdf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:29.919492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959002-2265-4ea1-891b-093ca4524fdf None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:29.920885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:29.925960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2b8a-84a6-4306-8e04-83a66064bd47 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:29.926422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2b8a-84a6-4306-8e04-83a66064bd47 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:29.926555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2b8a-84a6-4306-8e04-83a66064bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:29.944781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-172f2b8a-84a6-4306-8e04-83a66064bd47 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:29.945971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-172f2b8a-84a6-4306-8e04-83a66064bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:29.953857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:30.104598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6959002-2265-4ea1-891b-093ca4524fdf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:30.118820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6959002-2265-4ea1-891b-093ca4524fdf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:30.124164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ad751-da0a-4c2a-aca9-e1050125f8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:30.124802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ad751-da0a-4c2a-aca9-e1050125f8b6 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:30.125101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ad751-da0a-4c2a-aca9-e1050125f8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:30.125368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ad751-da0a-4c2a-aca9-e1050125f8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:30.133842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ad751-da0a-4c2a-aca9-e1050125f8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:30.135475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ad751-da0a-4c2a-aca9-e1050125f8b6 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:30.145356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 758/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:34.421930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0012aa-289b-4ffe-a602-62b30faf491f None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:34.422517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0012aa-289b-4ffe-a602-62b30faf491f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:34.422517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0012aa-289b-4ffe-a602-62b30faf491f None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:34.423895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:34.429852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5747b-6cc0-4661-84fe-e764aed43ed6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:34.430302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5747b-6cc0-4661-84fe-e764aed43ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:34.430444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5747b-6cc0-4661-84fe-e764aed43ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:34.447807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e1b5747b-6cc0-4661-84fe-e764aed43ed6 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:34.449033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e1b5747b-6cc0-4661-84fe-e764aed43ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:34.456579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:34.492914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0012aa-289b-4ffe-a602-62b30faf491f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:34.494624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1a0012aa-289b-4ffe-a602-62b30faf491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:34.551242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0012aa-289b-4ffe-a602-62b30faf491f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:34.554698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a612733-b45d-431d-9ef1-de130f0e24e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:34.555329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612733-b45d-431d-9ef1-de130f0e24e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:34.555610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612733-b45d-431d-9ef1-de130f0e24e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:34.555884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612733-b45d-431d-9ef1-de130f0e24e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:34.564607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a612733-b45d-431d-9ef1-de130f0e24e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:34.566032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a612733-b45d-431d-9ef1-de130f0e24e1 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:34.575201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 771/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:36.775159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8b5e2-ffb5-40ee-8ba1-0fd89f8283f8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:36.775775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8b5e2-ffb5-40ee-8ba1-0fd89f8283f8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:36.775775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8b5e2-ffb5-40ee-8ba1-0fd89f8283f8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:36.777087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:36.782227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acd81-7056-4b7c-941a-bd13ecfebf77 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:36.782621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acd81-7056-4b7c-941a-bd13ecfebf77 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:36.782811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acd81-7056-4b7c-941a-bd13ecfebf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:36.800844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ce6acd81-7056-4b7c-941a-bd13ecfebf77 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:36.802046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ce6acd81-7056-4b7c-941a-bd13ecfebf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:36.809844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:36.845264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8b5e2-ffb5-40ee-8ba1-0fd89f8283f8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:36.855809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8b5e2-ffb5-40ee-8ba1-0fd89f8283f8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:36.859297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5863820-90c7-4fbd-92f5-9ea0528c6734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:36.859925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863820-90c7-4fbd-92f5-9ea0528c6734 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:36.860210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863820-90c7-4fbd-92f5-9ea0528c6734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:36.860515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863820-90c7-4fbd-92f5-9ea0528c6734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:36.869372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5863820-90c7-4fbd-92f5-9ea0528c6734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:36.870824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5863820-90c7-4fbd-92f5-9ea0528c6734 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:36.880558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 761/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:40.596517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76645bf-fac1-48eb-9bfd-63db1469164a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:40.597042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76645bf-fac1-48eb-9bfd-63db1469164a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:40.597042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76645bf-fac1-48eb-9bfd-63db1469164a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:40.598407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:42:40.603720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91089225-3ca4-4578-97f7-6c921b7ea50f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:40.604149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91089225-3ca4-4578-97f7-6c921b7ea50f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:40.604293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91089225-3ca4-4578-97f7-6c921b7ea50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:40.622547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-91089225-3ca4-4578-97f7-6c921b7ea50f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:40.623719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-91089225-3ca4-4578-97f7-6c921b7ea50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:40.631643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:40.904033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76645bf-fac1-48eb-9bfd-63db1469164a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:40.905733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f76645bf-fac1-48eb-9bfd-63db1469164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:40.962198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76645bf-fac1-48eb-9bfd-63db1469164a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:40.965776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7c3e-03cb-4e41-bad6-5f8fe83a27f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:40.966445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7c3e-03cb-4e41-bad6-5f8fe83a27f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:40.966732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7c3e-03cb-4e41-bad6-5f8fe83a27f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:40.967042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7c3e-03cb-4e41-bad6-5f8fe83a27f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:40.976594 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7c3e-03cb-4e41-bad6-5f8fe83a27f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:40.978065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7c3e-03cb-4e41-bad6-5f8fe83a27f8 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:40.982987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:40.987638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 774/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:43.252324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591c01-e9c4-44c2-9946-77eeac31873c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:43.252997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591c01-e9c4-44c2-9946-77eeac31873c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:43.252997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591c01-e9c4-44c2-9946-77eeac31873c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:43.254312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:42:43.259430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ca919-ae22-45f1-bba3-9260f33fa7bc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:43.259826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ca919-ae22-45f1-bba3-9260f33fa7bc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:43.259995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ca919-ae22-45f1-bba3-9260f33fa7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:43.280220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-885ca919-ae22-45f1-bba3-9260f33fa7bc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:42:43.281435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-885ca919-ae22-45f1-bba3-9260f33fa7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:43.289705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:42:43.558827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27591c01-e9c4-44c2-9946-77eeac31873c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:42:43.560503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-27591c01-e9c4-44c2-9946-77eeac31873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:42:43.568054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:43.573855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27591c01-e9c4-44c2-9946-77eeac31873c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:42:43.577400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4b507-18b5-40b1-80e2-dd8719c35dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:42:43.578195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b507-18b5-40b1-80e2-dd8719c35dfe service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:42:43.578617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b507-18b5-40b1-80e2-dd8719c35dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:42:43.578894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b507-18b5-40b1-80e2-dd8719c35dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:42:43.587573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4b507-18b5-40b1-80e2-dd8719c35dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:42:43.589070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4b507-18b5-40b1-80e2-dd8719c35dfe service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:42:43.598764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 764/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:42:53.273329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:53.614874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:17.159873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20db7-5bb9-47e2-a044-ca5da0b37033 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.159873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20db7-5bb9-47e2-a044-ca5da0b37033 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.159873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20db7-5bb9-47e2-a044-ca5da0b37033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.198562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4af20db7-5bb9-47e2-a044-ca5da0b37033 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.199811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4af20db7-5bb9-47e2-a044-ca5da0b37033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.212915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 776/1540] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.223518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78d13b-6c1c-46e7-8c8a-48bd9b5cb83f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.224126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78d13b-6c1c-46e7-8c8a-48bd9b5cb83f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.224126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78d13b-6c1c-46e7-8c8a-48bd9b5cb83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.253308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ef78d13b-6c1c-46e7-8c8a-48bd9b5cb83f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.254536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ef78d13b-6c1c-46e7-8c8a-48bd9b5cb83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.269544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 765/1541] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.274377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20db7-5bb9-47e2-a044-ca5da0b37033 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.289644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20db7-5bb9-47e2-a044-ca5da0b37033 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.295276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbe775-6023-4b6a-8b43-7181cd195b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.296018 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbe775-6023-4b6a-8b43-7181cd195b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.296311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbe775-6023-4b6a-8b43-7181cd195b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.296596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbe775-6023-4b6a-8b43-7181cd195b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.297374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbe775-6023-4b6a-8b43-7181cd195b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:17.297961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbe775-6023-4b6a-8b43-7181cd195b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.303375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbe775-6023-4b6a-8b43-7181cd195b8e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.322647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 777/1542] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:17.327295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78d13b-6c1c-46e7-8c8a-48bd9b5cb83f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.348995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78d13b-6c1c-46e7-8c8a-48bd9b5cb83f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.357285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.357984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.358395 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.358678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.359392 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.361924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.395480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc06-4e99-49fd-a57e-aa0b1e44a785 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.401495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc06-4e99-49fd-a57e-aa0b1e44a785 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.401495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc06-4e99-49fd-a57e-aa0b1e44a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.420205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7d38cc06-4e99-49fd-a57e-aa0b1e44a785 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.421455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7d38cc06-4e99-49fd-a57e-aa0b1e44a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.433467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 778/1543] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.444386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f41006-ba42-4027-a88c-6f286a62bc1a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.444717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f41006-ba42-4027-a88c-6f286a62bc1a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.444961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f41006-ba42-4027-a88c-6f286a62bc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.457302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 766/1544] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:17.462181 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.469723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e0f41006-ba42-4027-a88c-6f286a62bc1a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.471043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e0f41006-ba42-4027-a88c-6f286a62bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.568699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cc15-53e2-4d2c-a88a-1d43ba466b98 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.571401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 779/1545] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.575840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f41006-ba42-4027-a88c-6f286a62bc1a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.578029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa6136-f7a7-49b7-9dfa-feff91eb493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.578884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6136-f7a7-49b7-9dfa-feff91eb493f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.579173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6136-f7a7-49b7-9dfa-feff91eb493f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.579451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6136-f7a7-49b7-9dfa-feff91eb493f admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.580159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa6136-f7a7-49b7-9dfa-feff91eb493f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.581262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-fdfa6136-f7a7-49b7-9dfa-feff91eb493f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:44:17.581262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: warnings.warn(msg) May 19 21:44:17.581262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: May 19 21:44:17.582644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa6136-f7a7-49b7-9dfa-feff91eb493f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.585865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f41006-ba42-4027-a88c-6f286a62bc1a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.607346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa5ffb-43f6-499e-bb5e-e43c8b7b9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.614882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5ffb-43f6-499e-bb5e-e43c8b7b9da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.614882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5ffb-43f6-499e-bb5e-e43c8b7b9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.614882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5ffb-43f6-499e-bb5e-e43c8b7b9da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.614882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa5ffb-43f6-499e-bb5e-e43c8b7b9da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:17.614882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa5ffb-43f6-499e-bb5e-e43c8b7b9da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.614882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa5ffb-43f6-499e-bb5e-e43c8b7b9da7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.629400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 780/1546] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:44:17.631003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e4dd8-5b8e-4ac2-b933-f70160337560 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.631307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e4dd8-5b8e-4ac2-b933-f70160337560 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.631592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e4dd8-5b8e-4ac2-b933-f70160337560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.655037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-741e4dd8-5b8e-4ac2-b933-f70160337560 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.656241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-741e4dd8-5b8e-4ac2-b933-f70160337560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.678803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 781/1547] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.679593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e4dd8-5b8e-4ac2-b933-f70160337560 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.695104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e4dd8-5b8e-4ac2-b933-f70160337560 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.701681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 767/1548] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:17.703211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dabb5d-eb51-4df1-bc90-8b189289a414 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.703516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dabb5d-eb51-4df1-bc90-8b189289a414 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.703815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dabb5d-eb51-4df1-bc90-8b189289a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.707564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.708261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.708548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.708831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.709542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.710935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:44:17.710935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:44:17.710935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:44:17.712154 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.743095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b2dabb5d-eb51-4df1-bc90-8b189289a414 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.744428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b2dabb5d-eb51-4df1-bc90-8b189289a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.754342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 768/1549] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.755907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d25e9-c442-481d-a3fe-cb95fbb51f72 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.756701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d25e9-c442-481d-a3fe-cb95fbb51f72 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.756981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d25e9-c442-481d-a3fe-cb95fbb51f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.777070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-106d25e9-c442-481d-a3fe-cb95fbb51f72 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.778337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-106d25e9-c442-481d-a3fe-cb95fbb51f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.788121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 769/1550] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.789637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c28c-d443-4881-92c1-7cf6276a7d2f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.789928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c28c-d443-4881-92c1-7cf6276a7d2f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.790293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c28c-d443-4881-92c1-7cf6276a7d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.794011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 782/1551] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:17.795479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.824668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4cd7c28c-d443-4881-92c1-7cf6276a7d2f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.827267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4cd7c28c-d443-4881-92c1-7cf6276a7d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.893163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b85fc-399f-4a2e-b419-9a1010cbc924 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.899479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfa54d-2807-496d-b975-3aef400e5553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.900248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfa54d-2807-496d-b975-3aef400e5553 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.900633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfa54d-2807-496d-b975-3aef400e5553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.900983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfa54d-2807-496d-b975-3aef400e5553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.901717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfa54d-2807-496d-b975-3aef400e5553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.903402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfa54d-2807-496d-b975-3aef400e5553 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.914093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 770/1552] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.915470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 783/1553] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:17.916751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5220f-ddff-444d-b568-1689be17812a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.917046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5220f-ddff-444d-b568-1689be17812a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.917324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5220f-ddff-444d-b568-1689be17812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.918408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3b78-11d9-4882-a630-65dd1d2575f9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.918709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3b78-11d9-4882-a630-65dd1d2575f9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.918989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3b78-11d9-4882-a630-65dd1d2575f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.938085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0c7e3b78-11d9-4882-a630-65dd1d2575f9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.938531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a2e5220f-ddff-444d-b568-1689be17812a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:17.939243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0c7e3b78-11d9-4882-a630-65dd1d2575f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.939745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a2e5220f-ddff-444d-b568-1689be17812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:17.947179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 771/1554] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.947571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 784/1555] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:17.948281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e3b78-11d9-4882-a630-65dd1d2575f9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.951387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5220f-ddff-444d-b568-1689be17812a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:17.959365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e3b78-11d9-4882-a630-65dd1d2575f9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.961734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5220f-ddff-444d-b568-1689be17812a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:17.963985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.964646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.964939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.965221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.965974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:17.966309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.966997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:17.967333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:44:17.967333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: warnings.warn(msg) May 19 21:44:17.967333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: May 19 21:44:17.967655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.967939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.968218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:17.968319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488fdbf-28be-4b93-99c6-0d46bd781be9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.968924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:17.971410 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:17.981004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 772/1556] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:17.982994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61011463-ce7e-47db-af7f-943049eb849d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:17.983423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61011463-ce7e-47db-af7f-943049eb849d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:17.983709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61011463-ce7e-47db-af7f-943049eb849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.002700 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-61011463-ce7e-47db-af7f-943049eb849d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:18.003898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-61011463-ce7e-47db-af7f-943049eb849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:18.012022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 773/1557] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:18.013207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94416-bad2-4cab-a51a-e0a53f4a0e56 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.014493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94416-bad2-4cab-a51a-e0a53f4a0e56 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.014493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94416-bad2-4cab-a51a-e0a53f4a0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.031315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-eac94416-bad2-4cab-a51a-e0a53f4a0e56 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:18.032486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-eac94416-bad2-4cab-a51a-e0a53f4a0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:18.041239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 774/1558] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:18.042026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94416-bad2-4cab-a51a-e0a53f4a0e56 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.051535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94416-bad2-4cab-a51a-e0a53f4a0e56 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.056217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66bcec-81a1-4b41-bc6e-b1010c86ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.056880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66bcec-81a1-4b41-bc6e-b1010c86ce02 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.057168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66bcec-81a1-4b41-bc6e-b1010c86ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.057443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66bcec-81a1-4b41-bc6e-b1010c86ce02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.058152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66bcec-81a1-4b41-bc6e-b1010c86ce02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.061666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66bcec-81a1-4b41-bc6e-b1010c86ce02 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.069812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 775/1559] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:18.071046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de21d-ab16-48a1-bfb7-7d96481497e7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.071336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de21d-ab16-48a1-bfb7-7d96481497e7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.071618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de21d-ab16-48a1-bfb7-7d96481497e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.078248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:18.088501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bd5de21d-ab16-48a1-bfb7-7d96481497e7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:18.092649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 785/1560] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:17 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.092766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bd5de21d-ab16-48a1-bfb7-7d96481497e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:18.092882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.097160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:18.099589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 776/1561] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:18.100865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb894-8f58-4197-8728-48f6443a0a1a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.100988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b99c-584a-472f-9247-80b40e27b2cb admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.101156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb894-8f58-4197-8728-48f6443a0a1a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.101542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb894-8f58-4197-8728-48f6443a0a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.105886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.106568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.106931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.107220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.107935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:18.108241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.109844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.121977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1f8bb894-8f58-4197-8728-48f6443a0a1a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:18.123103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 786/1562] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:18.123915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.130559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1f8bb894-8f58-4197-8728-48f6443a0a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:18.135164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894880-23d4-43da-943f-49bf443e8a7c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.139690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 777/1563] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:18.140653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65121778-800c-4360-aa09-3a6d8c1d2831 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.141051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65121778-800c-4360-aa09-3a6d8c1d2831 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.141438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65121778-800c-4360-aa09-3a6d8c1d2831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.144663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.145510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.145852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.146191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.147494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.149548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.162115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-65121778-800c-4360-aa09-3a6d8c1d2831 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:18.163421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-65121778-800c-4360-aa09-3a6d8c1d2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:18.171526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 778/1564] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:18.172835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1155033-4d3a-490a-8c98-c1418ec5806d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.173196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1155033-4d3a-490a-8c98-c1418ec5806d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.173540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1155033-4d3a-490a-8c98-c1418ec5806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.192562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a1155033-4d3a-490a-8c98-c1418ec5806d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:18.193686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a1155033-4d3a-490a-8c98-c1418ec5806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:18.201544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 779/1565] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:18.202446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1155033-4d3a-490a-8c98-c1418ec5806d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.212325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1155033-4d3a-490a-8c98-c1418ec5806d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.216832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.217686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.217969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.218350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] PATH_INFO: `/v3/projects/1d4839e190b84180bbe09a9bbbd06c1d/users/5205045922ca4dab8d556845be5f574b/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.232854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4839e190b84180bbe09a9bbbd06c1d, user_id=5205045922ca4dab8d556845be5f574b, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.235554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.302222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 787/1566] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.303081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.341780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 780/1567] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:18 2022] PUT /identity/v3/projects/1d4839e190b84180bbe09a9bbbd06c1d/users/5205045922ca4dab8d556845be5f574b/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:18.342656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.364547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ef366-2344-4eac-9874-8ce25f499523 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.405479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c000661-aa93-4895-9bdc-69f11b7c65bf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.410902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.411666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.411951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.412226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.412950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:18.413257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.414894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.421752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.422451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.422788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.423073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.423790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.425464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.426260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 781/1568] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:18.433623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.436907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7969-af4c-45f8-b801-3c600f16174a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.437542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 788/1569] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:18.438443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.444494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212482-64e3-444e-a72e-dea19a857889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.445090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212482-64e3-444e-a72e-dea19a857889 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.445373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212482-64e3-444e-a72e-dea19a857889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.445651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212482-64e3-444e-a72e-dea19a857889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.446383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7212482-64e3-444e-a72e-dea19a857889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.448293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7212482-64e3-444e-a72e-dea19a857889 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.449552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5bf9-a0e6-4b06-a6e3-9a9ade561bc7 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.454636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.455793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.456080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.456357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.457068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:18.457815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.459857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.472466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 789/1570] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:18.479592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.482641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403864-4488-4ced-ae3b-7414a786a096 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.487311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.487971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.488238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.488522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.489224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:18.489534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.491145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.502458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 790/1571] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:18.503232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.512324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b683b8-0b1e-44c4-88e8-fe3ed17b6868 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.516903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.517510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.518358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.518643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.519381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:18.519694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.521362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.535560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 791/1572] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:18.536364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.546940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa4696-e9f7-4e52-8ec2-76852dcd2d2a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.551521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.552194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.552479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.552756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.553436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.555386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.571190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 782/1573] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.572654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49856ac-c9ee-4d7f-9872-3916f33cb886 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.572942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49856ac-c9ee-4d7f-9872-3916f33cb886 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.573221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49856ac-c9ee-4d7f-9872-3916f33cb886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.590697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c49856ac-c9ee-4d7f-9872-3916f33cb886 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:18.591888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c49856ac-c9ee-4d7f-9872-3916f33cb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:18.648615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 783/1574] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:18.649488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49856ac-c9ee-4d7f-9872-3916f33cb886 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.658944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49856ac-c9ee-4d7f-9872-3916f33cb886 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.663870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 792/1575] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.664014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.664586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.664872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.665148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.665243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.665853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.667949 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.676906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cfb9-fc65-4dde-9940-e35707a3a188 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.681551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.682307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.682587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.682873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.683625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.685251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.695944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 793/1576] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:18.696816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.702576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:18.707122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7be57-8850-428e-8cfc-741dae1db5aa admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.711827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.712461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.712745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.713020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.713699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.715698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.758046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 784/1577] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.758920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.764808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:18.818922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feff51-224a-4493-b64e-0a75c3984452 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.823562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.824206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.824489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.824762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.825443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.827384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.846239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 794/1578] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.846239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.903157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251d0f-b3f1-4c40-91d9-e6e85851357b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.907847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.908527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.908809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.909092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.909780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.912054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.913496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 785/1579] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.914358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:18.977160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df04532-68ef-4720-ad60-f48c95ca294a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:18.982200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:18.982889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:18.983184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:18.983463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:18.984148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:18.989564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 795/1580] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:18.993414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:18.993543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.049490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc8dfa-8fde-48b0-a493-5c6923047261 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.054385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.055053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.055340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.055617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.056335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.057935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.068183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 796/1581] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.068995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.071681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:19.083866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 786/1582] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:18 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:19.083866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.091547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145e04-40bd-4872-a743-78cc6631bd07 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.097047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.098202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.098530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.098799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] PATH_INFO: `/v3/projects/1f7abd999daa4491867a3b27809b0317/users/102a611e510d4087b09bf7206c2d302a/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.113804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7abd999daa4491867a3b27809b0317, user_id=102a611e510d4087b09bf7206c2d302a, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.116552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.131207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab08de-7bb2-4e30-b44e-183fd25d0b93 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.134745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.135384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.135667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.135945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.144686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.146104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.155255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 797/1583] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:19.156089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.165352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae9a3-7393-4023-af20-d2f3b1d183f7 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.169903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.170589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.170869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.171142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.171846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.173716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.183220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:19.192316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 787/1584] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:19 2022] PUT /identity/v3/projects/1f7abd999daa4491867a3b27809b0317/users/102a611e510d4087b09bf7206c2d302a/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:19.193208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.249919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:19.255297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72555c99-c65f-43de-a9c9-b48911a3e997 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.259943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.260601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.262337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.262337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.262337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.263874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.300511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 798/1585] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:19 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:19.301301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.311420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e93300-f576-4ea6-a5be-441a32d28265 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.316119 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.316824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.321257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.321257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.321257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.321257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.373334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 788/1586] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:19 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:19.374163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.383453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0b4a-a0ae-40ff-b1fc-92cdb6666b65 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.387972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.388604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.388892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.389172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.389840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.391795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.431365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 799/1587] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:19 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:19.432203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.441347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635b45a-78c4-4c88-9b65-33a4d3d6e454 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.445876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.446566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.446856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.447136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.447855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.449436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.459797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 800/1588] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.460613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.470270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe3c0-37cf-45c4-ac62-0137afad8205 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.475699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b53d0-e217-43a8-9071-9e0c7b8a6aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.476285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b53d0-e217-43a8-9071-9e0c7b8a6aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.476564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b53d0-e217-43a8-9071-9e0c7b8a6aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.477036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b53d0-e217-43a8-9071-9e0c7b8a6aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.477572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b53d0-e217-43a8-9071-9e0c7b8a6aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.479373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b53d0-e217-43a8-9071-9e0c7b8a6aa9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.491534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 801/1589] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.493765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c068-9d00-46fa-a703-5d49c2ddd987 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.493765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c068-9d00-46fa-a703-5d49c2ddd987 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.493765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c068-9d00-46fa-a703-5d49c2ddd987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.498845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 789/1590] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:19 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:19.502734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.513930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76d4e7-cb04-47c2-9439-4f1382456f22 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.528040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.528040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.528040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.528040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.528699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.528699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.536166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1d22c068-9d00-46fa-a703-5d49c2ddd987 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:19.537414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1d22c068-9d00-46fa-a703-5d49c2ddd987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:19.538461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 790/1591] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.539314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.546775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 802/1592] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:19.550429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce69da-d7fa-457e-90ac-235adc29eef0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.555195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c068-9d00-46fa-a703-5d49c2ddd987 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.555685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.556492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.556787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.557218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.558252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.560160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.567269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c068-9d00-46fa-a703-5d49c2ddd987 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.574681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 791/1593] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.574849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.574954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.575041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.575041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.575041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.575041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.575861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.582368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae1287-a659-4e38-909d-61c715404021 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.587215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 803/1594] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.587939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.590703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.594051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.594051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.594051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] PATH_INFO: `/v3/projects/33420cd77ce14e4187357e4ebb06420b/users/ef1f9cade74c44f590b737935dd59206/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.598638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6614ab-7c80-4a8b-822a-f5a347a446fd admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.603180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.603830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.604114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.604391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.605102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.606729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.608069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33420cd77ce14e4187357e4ebb06420b, user_id=ef1f9cade74c44f590b737935dd59206, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.610820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.617356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 804/1595] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.618290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.627858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e6b3a-38c0-43a9-8fe6-db909dd9b23e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.632337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.632953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.633240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.633525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.634233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.635796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.646028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 805/1596] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.646985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.656074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85945fe7-8462-40ed-b4ac-f9a3834f1712 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.661371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.663090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.663090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.663090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.663367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.664695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.674158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 806/1597] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.675070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.728799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7013-036d-44f0-a1c4-ea49f667078b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.729764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 792/1598] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:19 2022] PUT /identity/v3/projects/33420cd77ce14e4187357e4ebb06420b/users/ef1f9cade74c44f590b737935dd59206/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:19.740225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.796238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.797029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.797325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.797613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.813792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aa67d-630e-4602-80e8-cc947e2b2b7f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.820329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.821064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.821358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.821632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.822405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.824740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.840722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 793/1599] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.841669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.845066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:19.852632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aa1db-2bd8-4cc9-a014-484c04639c55 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.857274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.857957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.858236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.858532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.859387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.860993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.871251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 794/1600] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.874864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.878161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.879777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.881737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aa0f5-e0ad-457e-8ebd-4049ea793eae admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.886387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d30898-8ff4-4398-b913-c276394efc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.887248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30898-8ff4-4398-b913-c276394efc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.887531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30898-8ff4-4398-b913-c276394efc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.887815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30898-8ff4-4398-b913-c276394efc66 admin admin] PATH_INFO: `/v3/projects/fcbe188b019b4c1aae20067569f249bf/users/082a80f9693d47f0b57ba71436b1c5b3/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.889275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 807/1601] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:19.890051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.899647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f85d68-7509-4547-a312-ab2a7488ec3e service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.904372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.905131 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.905320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.905595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.906343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.906550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d30898-8ff4-4398-b913-c276394efc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbe188b019b4c1aae20067569f249bf, user_id=082a80f9693d47f0b57ba71436b1c5b3, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.907952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.910655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d30898-8ff4-4398-b913-c276394efc66 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.918966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 808/1602] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:19.919766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:19.929484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfdf5-789f-4a7b-a1ba-2999bf395764 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:19.934083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:19.934971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.935259 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.935535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] PATH_INFO: `/v3/projects/10ef2894c29c4720855ab8137a7ce757/users/596d85b923064caeada31792c6883c57/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:19.951005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ef2894c29c4720855ab8137a7ce757, user_id=596d85b923064caeada31792c6883c57, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:19.952093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:44:19.952093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:44:19.952093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:44:19.954051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:19.986674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 795/1603] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:19 2022] PUT /identity/v3/projects/fcbe188b019b4c1aae20067569f249bf/users/082a80f9693d47f0b57ba71436b1c5b3/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:19.986674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9c04-2011-40ea-beac-a72f1ac46038 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:19.986674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9c04-2011-40ea-beac-a72f1ac46038 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:19.986674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9c04-2011-40ea-beac-a72f1ac46038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.015695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7fca9c04-2011-40ea-beac-a72f1ac46038 None None] MFA Rules not processed for user `ef1f9cade74c44f590b737935dd59206`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:20.017016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7fca9c04-2011-40ea-beac-a72f1ac46038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:20.052391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:20.061033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 809/1604] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:19 2022] PUT /identity/v3/projects/10ef2894c29c4720855ab8137a7ce757/users/596d85b923064caeada31792c6883c57/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:20.072338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.102339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 796/1605] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:20.103364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca9c04-2011-40ea-beac-a72f1ac46038 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.134317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159485-42b7-4c26-913d-2114850198cc admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:20.139140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:20.140117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.140471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.140817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] PATH_INFO: `/v3/projects/5b42e3ff41384cafaebde677d260ae34/users/bafd0e09a6134be080a352b63d867356/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.155465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b42e3ff41384cafaebde677d260ae34, user_id=bafd0e09a6134be080a352b63d867356, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:20.158203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:20.168971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca9c04-2011-40ea-beac-a72f1ac46038 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:20.173595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f6d2-95e4-49d0-af41-43d6feb403b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:20.174585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f6d2-95e4-49d0-af41-43d6feb403b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.174864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f6d2-95e4-49d0-af41-43d6feb403b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.175143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f6d2-95e4-49d0-af41-43d6feb403b6 admin admin] PATH_INFO: `/v3/projects/06eaad19610a4b4aaf747a2bb971e5dd/users/8103d5e02eee4026a6fb6d19c446c0cf/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.188972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f6d2-95e4-49d0-af41-43d6feb403b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eaad19610a4b4aaf747a2bb971e5dd, user_id=8103d5e02eee4026a6fb6d19c446c0cf, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:20.194170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f6d2-95e4-49d0-af41-43d6feb403b6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:20.246660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 810/1606] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:20 2022] PUT /identity/v3/projects/5b42e3ff41384cafaebde677d260ae34/users/bafd0e09a6134be080a352b63d867356/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:20.246660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.276334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 797/1607] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:20 2022] PUT /identity/v3/projects/06eaad19610a4b4aaf747a2bb971e5dd/users/8103d5e02eee4026a6fb6d19c446c0cf/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:20.279208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479815-e16b-4668-84ec-b3ff73df5f5d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.279704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479815-e16b-4668-84ec-b3ff73df5f5d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.281060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479815-e16b-4668-84ec-b3ff73df5f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.312871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-57479815-e16b-4668-84ec-b3ff73df5f5d None None] MFA Rules not processed for user `082a80f9693d47f0b57ba71436b1c5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:20.316039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-57479815-e16b-4668-84ec-b3ff73df5f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:20.326294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fe0c5-2ec6-42eb-be72-71d040c2b00d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:20.343951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:20.384468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:20.385003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 798/1608] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:20.385488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.385778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.386059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] PATH_INFO: `/v3/projects/cc319879922d44af97106ac334881d0e/users/7d99b5e07024444f899a43ddfb7d0e62/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.386420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882578-32bc-4b5d-9263-303df03dc8b6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.386713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882578-32bc-4b5d-9263-303df03dc8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.386992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882578-32bc-4b5d-9263-303df03dc8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.405961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc319879922d44af97106ac334881d0e, user_id=7d99b5e07024444f899a43ddfb7d0e62, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:20.408577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:20.415620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6f882578-32bc-4b5d-9263-303df03dc8b6 None None] MFA Rules not processed for user `596d85b923064caeada31792c6883c57`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:20.416880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6f882578-32bc-4b5d-9263-303df03dc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:20.457614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:20.478713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 811/1609] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:20 2022] PUT /identity/v3/projects/cc319879922d44af97106ac334881d0e/users/7d99b5e07024444f899a43ddfb7d0e62/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:20.481495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.508060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 799/1610] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:20.509744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcd56-9464-4747-8b8d-4d48d7f1b224 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.510686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcd56-9464-4747-8b8d-4d48d7f1b224 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.511251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcd56-9464-4747-8b8d-4d48d7f1b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.542768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-176dcd56-9464-4747-8b8d-4d48d7f1b224 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:20.544283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-176dcd56-9464-4747-8b8d-4d48d7f1b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:20.574555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8dac9-6497-492a-89ef-29e4184d810c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:20.579759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:20.580609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.580895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.581177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.581978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:20.583992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:20.620754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 800/1611] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:20.622271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7523-ed7c-48f4-9900-b708b3c8be65 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.622545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7523-ed7c-48f4-9900-b708b3c8be65 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.622833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7523-ed7c-48f4-9900-b708b3c8be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.652508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2dff7523-ed7c-48f4-9900-b708b3c8be65 None None] MFA Rules not processed for user `8103d5e02eee4026a6fb6d19c446c0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:20.653730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2dff7523-ed7c-48f4-9900-b708b3c8be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:20.680922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 812/1612] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:20.681865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.769189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 801/1613] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:20.770735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc96699-9928-4ce8-b8fa-28ad71f7587d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.771056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc96699-9928-4ce8-b8fa-28ad71f7587d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.771337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc96699-9928-4ce8-b8fa-28ad71f7587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.776080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4a250-957d-4bc5-9820-6943f2d1e46d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:20.787052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:20.787052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.787052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.787052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.787434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:20.789989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:20.795208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7cc96699-9928-4ce8-b8fa-28ad71f7587d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:20.796529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7cc96699-9928-4ce8-b8fa-28ad71f7587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:20.817162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 802/1614] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:20.824532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc96699-9928-4ce8-b8fa-28ad71f7587d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.838330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc96699-9928-4ce8-b8fa-28ad71f7587d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:20.843853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:20.844518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:20.844802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:20.845081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:20.846397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:20.848335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:20.939272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 813/1615] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/projects => generated 405 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:20.939272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.958616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 803/1616] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:20.961707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:20.968307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:21.015073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199e6d-5e2e-402f-bb1c-36d94704200e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.017806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:21.048843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d063-f140-4e0e-9ba8-7c34de6ea195 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.054738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.055763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.056552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.057904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.059845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.065084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.078641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015858fc-149c-4568-a4e0-340247af7f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.079361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015858fc-149c-4568-a4e0-340247af7f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.079994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015858fc-149c-4568-a4e0-340247af7f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.080290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015858fc-149c-4568-a4e0-340247af7f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.092604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015858fc-149c-4568-a4e0-340247af7f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.094483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015858fc-149c-4568-a4e0-340247af7f58 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.105546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 814/1617] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:21.106746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea21bb-bb04-4b34-a49d-ccf85a13dd84 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.107186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea21bb-bb04-4b34-a49d-ccf85a13dd84 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.107470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea21bb-bb04-4b34-a49d-ccf85a13dd84 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.114462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 815/1618] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 19 21:44:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:21.115590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea21bb-bb04-4b34-a49d-ccf85a13dd84 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.129029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea21bb-bb04-4b34-a49d-ccf85a13dd84 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.133420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.133973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.134294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.137080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.147089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.148604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.161294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 816/1619] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:21.162056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.171789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d048e-15a2-414e-aa9d-3de0bf1c06e1 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.182832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 804/1620] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:20 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:21.186998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.200310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.201467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.201467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.201672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.202454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.205898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ce840-2790-471d-b544-4d8fd4f25c97 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.207926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.223242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef27f74-8b28-4f9b-90e2-b55d4ba11956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.224069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27f74-8b28-4f9b-90e2-b55d4ba11956 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.225463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27f74-8b28-4f9b-90e2-b55d4ba11956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.225463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27f74-8b28-4f9b-90e2-b55d4ba11956 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.225687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef27f74-8b28-4f9b-90e2-b55d4ba11956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.231079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef27f74-8b28-4f9b-90e2-b55d4ba11956 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.310295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 805/1621] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:21 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:21.310933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 817/1622] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:21 2022] POST /identity/v3/users => generated 309 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:21.314160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b0511-e979-48e7-b58a-6e9da6d3a362 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.314344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.314510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b0511-e979-48e7-b58a-6e9da6d3a362 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.314803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b0511-e979-48e7-b58a-6e9da6d3a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.339348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878edf2-146c-4f5d-8da9-5675e1f988d3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.347639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d21b0511-e979-48e7-b58a-6e9da6d3a362 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:21.348875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d21b0511-e979-48e7-b58a-6e9da6d3a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:21.350140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.351993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.352420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.353363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.354573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.357715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.371414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 818/1623] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:21.372309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.388004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec750bc-d75c-4351-9d1f-dab353cf316e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.405757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.406484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.406774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.407055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.407787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.409427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.435312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 806/1624] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 19 21:44:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:21.439755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 819/1625] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:21.441047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.447947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b0511-e979-48e7-b58a-6e9da6d3a362 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.471563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b0511-e979-48e7-b58a-6e9da6d3a362 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.482949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198545-8186-4075-aa57-1f4daf571c1f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.491224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.492429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.493042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.493533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.495697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.497475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.498417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.499740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.500023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.500302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.501034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.516203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.519193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 807/1626] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:21.520571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.536115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c036-38b7-4eb7-977f-e507d152b14e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.542029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.554470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.554470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.554470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] PATH_INFO: `/v3/projects/4757c517a2d04e6bbb331ca35319e427/users/0997bec568204210865b8542cd397bbb/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.554751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 820/1627] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:21.554751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.567843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4757c517a2d04e6bbb331ca35319e427, user_id=0997bec568204210865b8542cd397bbb, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.572200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.589535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b202cb1-96a1-4fec-944d-0aacf34114b6 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.603626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.604309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.604599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.604876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.682498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.685242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.696527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 821/1628] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:21.697551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.709129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d100876-8286-4851-ba00-66463e9a2e67 service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.714036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:21.715011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:21.715296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:21.715572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] PATH_INFO: `/v3/projects/0a220e6207dd4993baafcf225de4175d/users/4ab064ce4a98438094f53e1e1d5d7edf/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:21.719876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:21.727524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 808/1629] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:21 2022] PUT /identity/v3/projects/4757c517a2d04e6bbb331ca35319e427/users/0997bec568204210865b8542cd397bbb/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:21.731557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.738915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a220e6207dd4993baafcf225de4175d, user_id=4ab064ce4a98438094f53e1e1d5d7edf, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:21.741723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:21.834511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 822/1630] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:21 2022] PUT /identity/v3/projects/0a220e6207dd4993baafcf225de4175d/users/4ab064ce4a98438094f53e1e1d5d7edf/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:21.837462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:21.929261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010fee1-2a3b-41ad-957b-468557e405c8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:21.948632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:22.014603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab04e9-06b0-4923-9830-ec97206d961d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:22.025511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:22.026636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.027072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.027520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.028393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:22.030151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:22.047697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 823/1631] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:22.049829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:22.062922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba617-b463-4865-8b33-eb0874999ab8 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:22.085600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:22.086640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.087023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.087306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.088763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:22.090572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:22.097621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b904f4-9197-4c3e-a8ba-5d41bb9a87b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:22.098685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b904f4-9197-4c3e-a8ba-5d41bb9a87b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.098976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b904f4-9197-4c3e-a8ba-5d41bb9a87b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.099261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b904f4-9197-4c3e-a8ba-5d41bb9a87b4 admin admin] PATH_INFO: `/v3/projects/4fe4a50ae8bc401f81e3fb501c02ac36/users/53553a9eb0fc410cb7eff87ed475be30/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.121269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 824/1632] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:22.121269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:22.137794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b904f4-9197-4c3e-a8ba-5d41bb9a87b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe4a50ae8bc401f81e3fb501c02ac36, user_id=53553a9eb0fc410cb7eff87ed475be30, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:22.140250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69682e4-b00b-4cd0-a8f1-7dc4944d2921 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:22.143779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b904f4-9197-4c3e-a8ba-5d41bb9a87b4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:22.156877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:22.157793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.158110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.158441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] PATH_INFO: `/v3/projects/4757c517a2d04e6bbb331ca35319e427/users/0997bec568204210865b8542cd397bbb/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.170155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4757c517a2d04e6bbb331ca35319e427, user_id=0997bec568204210865b8542cd397bbb, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:22.172845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:22.201331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 825/1633] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:22 2022] PUT /identity/v3/projects/4757c517a2d04e6bbb331ca35319e427/users/0997bec568204210865b8542cd397bbb/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:22.202467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:22.258020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 809/1634] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:21 2022] PUT /identity/v3/projects/4fe4a50ae8bc401f81e3fb501c02ac36/users/53553a9eb0fc410cb7eff87ed475be30/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:22.259738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef4229-dd23-4d28-a49a-cea6068b5326 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.261069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef4229-dd23-4d28-a49a-cea6068b5326 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.261069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef4229-dd23-4d28-a49a-cea6068b5326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.315892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6663c-6eb3-4ebd-9056-8eff2fc2b6f8 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:22.327211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-31ef4229-dd23-4d28-a49a-cea6068b5326 None None] MFA Rules not processed for user `0997bec568204210865b8542cd397bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:22.339537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-31ef4229-dd23-4d28-a49a-cea6068b5326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:22.424843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:22.427083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.427550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.427995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] PATH_INFO: `/v3/projects/0a220e6207dd4993baafcf225de4175d/users/4ab064ce4a98438094f53e1e1d5d7edf/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.431913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 810/1635] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:22.431913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1fb06-23e8-46a9-a97a-24bdd4b5f217 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.431913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1fb06-23e8-46a9-a97a-24bdd4b5f217 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.431913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1fb06-23e8-46a9-a97a-24bdd4b5f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.435713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a220e6207dd4993baafcf225de4175d, user_id=4ab064ce4a98438094f53e1e1d5d7edf, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:22.438729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:22.452590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 826/1636] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:22 2022] PUT /identity/v3/projects/0a220e6207dd4993baafcf225de4175d/users/4ab064ce4a98438094f53e1e1d5d7edf/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:22.454384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:22.468473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7cc1fb06-23e8-46a9-a97a-24bdd4b5f217 None None] MFA Rules not processed for user `53553a9eb0fc410cb7eff87ed475be30`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:22.469687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7cc1fb06-23e8-46a9-a97a-24bdd4b5f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:22.554515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e4eb-dd70-4352-9f89-8b86ac681878 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:22.562021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:22.562981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.571375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.571375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.571778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 811/1637] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:22.573234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6eef-03ff-4fac-8e50-cc9e84f2176e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.573514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6eef-03ff-4fac-8e50-cc9e84f2176e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.573793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6eef-03ff-4fac-8e50-cc9e84f2176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.656202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-911b6eef-03ff-4fac-8e50-cc9e84f2176e None None] MFA Rules not processed for user `4ab064ce4a98438094f53e1e1d5d7edf`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:22.659363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-911b6eef-03ff-4fac-8e50-cc9e84f2176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:22.754769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:22.756528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:22.804640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 827/1638] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:22 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:22.805621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:22.875104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 812/1639] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:22.876810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d639b7-cf9e-49f8-9190-4b7fb02024b6 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.877706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d639b7-cf9e-49f8-9190-4b7fb02024b6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.878240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d639b7-cf9e-49f8-9190-4b7fb02024b6 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.881263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:22.886975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 813/1640] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 19 21:44:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:22.893351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d639b7-cf9e-49f8-9190-4b7fb02024b6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:22.921613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d639b7-cf9e-49f8-9190-4b7fb02024b6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:22.927271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd8bf-bbfe-43c8-9a4a-14effaf79e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:22.928329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd8bf-bbfe-43c8-9a4a-14effaf79e1a service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:22.930419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd8bf-bbfe-43c8-9a4a-14effaf79e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:22.932041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd8bf-bbfe-43c8-9a4a-14effaf79e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:22.975125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd8bf-bbfe-43c8-9a4a-14effaf79e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:22.978246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd8bf-bbfe-43c8-9a4a-14effaf79e1a service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:22.984770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8053dc-1f51-4523-ab26-7958e4498f88 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:23.001215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:23.002732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.002732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.002944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.003794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:23.006263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 814/1641] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:23.007510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:23.009769 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ec07-f0d8-4c15-8f1d-ac71cd7a5807 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.010559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ec07-f0d8-4c15-8f1d-ac71cd7a5807 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.011016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ec07-f0d8-4c15-8f1d-ac71cd7a5807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.028084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:23.367390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9173ec07-f0d8-4c15-8f1d-ac71cd7a5807 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:23.367390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9173ec07-f0d8-4c15-8f1d-ac71cd7a5807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:23.371845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 828/1642] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:22 2022] POST /identity/v3/projects => generated 385 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:23.371845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:23.375923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 815/1643] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 19 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:23.375923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3999-a4f9-4f26-b1d0-207515fcb356 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.375923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3999-a4f9-4f26-b1d0-207515fcb356 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.375923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3999-a4f9-4f26-b1d0-207515fcb356 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.375923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 816/1644] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 19 21:44:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:23.375923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f86c7f-be70-45ff-8393-d483461d8bc3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.375923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f86c7f-be70-45ff-8393-d483461d8bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.377718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f86c7f-be70-45ff-8393-d483461d8bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.377718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-67f86c7f-be70-45ff-8393-d483461d8bc3 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:23.377718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-67f86c7f-be70-45ff-8393-d483461d8bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:23.378743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf186f-f93d-4c52-b328-cb8b1b24a11e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:23.380785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:23.380785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.381220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.381582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.382951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:23.385030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:23.448014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 817/1645] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:23.449016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f86c7f-be70-45ff-8393-d483461d8bc3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:23.461217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f86c7f-be70-45ff-8393-d483461d8bc3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:23.466450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:23.467557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.467842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.468119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] PATH_INFO: `/v3/users/082a80f9693d47f0b57ba71436b1c5b3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.469336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=082a80f9693d47f0b57ba71436b1c5b3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:23.471398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:23.515414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 829/1646] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:23 2022] POST /identity/v3/users => generated 299 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:23.515414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:23.604577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8c1a-c49c-487a-8dac-52a11178f534 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:23.610714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:23.611955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.612216 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.612555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.624391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:23.626527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:23.640929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 830/1647] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:23.641882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:23.652847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343665cf-0b34-40bc-b57e-8c16270554b9 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:23.658877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:23.662459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.662459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.662459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.662459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:23.662909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:23.674781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 831/1648] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:23.675779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:23.686075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea38698-4faf-425f-bc51-0202c1d682b2 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:23.691459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2839c3-ca5e-46b3-b2d2-1c885b400ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:23.692113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2839c3-ca5e-46b3-b2d2-1c885b400ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.692402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2839c3-ca5e-46b3-b2d2-1c885b400ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.692683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2839c3-ca5e-46b3-b2d2-1c885b400ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.729251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082a80f9693d47f0b57ba71436b1c5b3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:23.744323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082a80f9693d47f0b57ba71436b1c5b3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:23.812802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2839c3-ca5e-46b3-b2d2-1c885b400ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:23.814299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2839c3-ca5e-46b3-b2d2-1c885b400ac3 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:23.828476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 832/1649] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:23.832629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082a80f9693d47f0b57ba71436b1c5b3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:23.834878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d42e7-80c6-4dab-a7d9-7c7f08c96de9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:23.836901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d42e7-80c6-4dab-a7d9-7c7f08c96de9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:23.840129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d42e7-80c6-4dab-a7d9-7c7f08c96de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:23.870440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082a80f9693d47f0b57ba71436b1c5b3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:23.871200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082a80f9693d47f0b57ba71436b1c5b3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:23.885064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 818/1650] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:23 2022] DELETE /identity/v3/users/082a80f9693d47f0b57ba71436b1c5b3 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:23.885912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:23.889157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:23.927212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-f28d42e7-80c6-4dab-a7d9-7c7f08c96de9 None None] MFA Rules not processed for user `7d99b5e07024444f899a43ddfb7d0e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:23.929340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f28d42e7-80c6-4dab-a7d9-7c7f08c96de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:24.057692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5302cb6-28e9-4b4c-a359-5d964fb11f36 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:24.065669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845762fe-7e19-4f0d-9e82-13930046d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:24.067044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845762fe-7e19-4f0d-9e82-13930046d914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.067335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845762fe-7e19-4f0d-9e82-13930046d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.067667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845762fe-7e19-4f0d-9e82-13930046d914 admin admin] PATH_INFO: `/v3/projects/650c174dfb22456dad71dec5f026bdc5/users/3849893f41cb42f39340a6caed3a4051/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.096862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 833/1651] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:24.096862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f92adf-64f0-4702-8516-b5c34e6c88e5 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.096862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f92adf-64f0-4702-8516-b5c34e6c88e5 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.096862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f92adf-64f0-4702-8516-b5c34e6c88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.102455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845762fe-7e19-4f0d-9e82-13930046d914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650c174dfb22456dad71dec5f026bdc5, user_id=3849893f41cb42f39340a6caed3a4051, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:24.105353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845762fe-7e19-4f0d-9e82-13930046d914 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:24.126389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e1f92adf-64f0-4702-8516-b5c34e6c88e5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:24.135049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:24.141184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e1f92adf-64f0-4702-8516-b5c34e6c88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:24.195361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 834/1652] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:24.197919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3f243-30de-42fd-a3a8-69d0df3561b9 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.198330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3f243-30de-42fd-a3a8-69d0df3561b9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.198824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3f243-30de-42fd-a3a8-69d0df3561b9 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.201007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 835/1653] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 19 21:44:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:24.202492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705200-f8f7-411a-b685-0961a43805c9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.202788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705200-f8f7-411a-b685-0961a43805c9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.203066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705200-f8f7-411a-b685-0961a43805c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.216625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 819/1654] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:23 2022] PUT /identity/v3/projects/650c174dfb22456dad71dec5f026bdc5/users/3849893f41cb42f39340a6caed3a4051/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:24.222431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.224089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.224702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.232707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-50705200-f8f7-411a-b685-0961a43805c9 None None] MFA Rules not processed for user `7d99b5e07024444f899a43ddfb7d0e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:24.233920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-50705200-f8f7-411a-b685-0961a43805c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:24.271530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:24.275918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:24.295608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:24.364897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 836/1655] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:24.364897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50705200-f8f7-411a-b685-0961a43805c9 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:24.452299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 820/1656] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:24.453291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:24.457993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:24.502647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50705200-f8f7-411a-b685-0961a43805c9 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:24.508736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:24.510134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.510653 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.511099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.522846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:24.522846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:24.531788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 837/1657] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:24.531788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:24.533707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:24.561340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a32a-3bb3-4430-b20b-835c5ae7d7df admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:24.563372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:24.564715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.565120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.565471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.578449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:24.580797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:24.607126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 838/1658] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:24.608249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:24.612928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:24.662154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f394dd-887c-4353-8c06-acb4351130c0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:24.676226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:24.676963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.677249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.677521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.703161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:24.704640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:24.711349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9a6b-41ab-4c23-8333-acd1b29a2f27 service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:24.716618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc42d09-9262-44d5-a57d-3ac0158fcaad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:24.717507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42d09-9262-44d5-a57d-3ac0158fcaad service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.717982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42d09-9262-44d5-a57d-3ac0158fcaad service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.718319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42d09-9262-44d5-a57d-3ac0158fcaad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.730141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:24.733450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42d09-9262-44d5-a57d-3ac0158fcaad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:24.738269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42d09-9262-44d5-a57d-3ac0158fcaad service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:24.744786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 821/1659] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:24.745551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:24.753565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 839/1660] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:24.768309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86481f-2895-4deb-8774-26ef1c62382a service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:24.784730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:24.786046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.786528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.786981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] PATH_INFO: `/v3/projects/650c174dfb22456dad71dec5f026bdc5/users/3849893f41cb42f39340a6caed3a4051/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.790676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650c174dfb22456dad71dec5f026bdc5, user_id=3849893f41cb42f39340a6caed3a4051, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:24.795712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:24.815209 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 822/1661] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:24 2022] PUT /identity/v3/projects/650c174dfb22456dad71dec5f026bdc5/users/3849893f41cb42f39340a6caed3a4051/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:24.828956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:24.829297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:24.829767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:24.903249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] MFA Rules not processed for user `3849893f41cb42f39340a6caed3a4051`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:24.903866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:25.011996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:25.029436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 840/1662] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:25.056438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:25.059492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:25.061682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:25.182831 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2bc5-9233-48d6-8612-f5ed1d1ef960 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:25.185703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f27a-a1f4-4cb6-99fe-2734fccb1cd6 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:25.191030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:25.192290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:25.192768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:25.193281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] PATH_INFO: `/v3/users/8103d5e02eee4026a6fb6d19c446c0cf` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:25.193911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f07ee-b8fb-4731-87ab-60f638f37453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:25.194723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f07ee-b8fb-4731-87ab-60f638f37453 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:25.195082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8103d5e02eee4026a6fb6d19c446c0cf)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:25.196184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f07ee-b8fb-4731-87ab-60f638f37453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:25.196544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f07ee-b8fb-4731-87ab-60f638f37453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:25.196767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: WARNING py.warnings [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:44:25.196767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: warnings.warn(msg) May 19 21:44:25.196767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: May 19 21:44:25.198451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:25.222946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f07ee-b8fb-4731-87ab-60f638f37453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:25.224436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f07ee-b8fb-4731-87ab-60f638f37453 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:25.254610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 823/1663] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:25.491715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8103d5e02eee4026a6fb6d19c446c0cf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:25.505524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8103d5e02eee4026a6fb6d19c446c0cf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:25.506555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8103d5e02eee4026a6fb6d19c446c0cf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:25.507639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8103d5e02eee4026a6fb6d19c446c0cf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:25.610202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8103d5e02eee4026a6fb6d19c446c0cf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:25.653244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 841/1664] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:25 2022] DELETE /identity/v3/users/8103d5e02eee4026a6fb6d19c446c0cf => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:25.657398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d271285-2d8f-4710-9ac3-5cf204c820c7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:25.657910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d271285-2d8f-4710-9ac3-5cf204c820c7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:25.658831 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d271285-2d8f-4710-9ac3-5cf204c820c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:25.701281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7d271285-2d8f-4710-9ac3-5cf204c820c7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:25.704338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7d271285-2d8f-4710-9ac3-5cf204c820c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:25.885908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 824/1665] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:25.899307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:25.944064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:25.948499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:26.104150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80b9dc-c935-4057-acf1-38b65924996f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:26.114535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:26.115265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:26.115567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:26.115856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:26.139392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:26.140953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:26.152335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24450524-6f92-41c8-960b-acdff13752dd None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:26.152629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24450524-6f92-41c8-960b-acdff13752dd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:26.152912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24450524-6f92-41c8-960b-acdff13752dd None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:26.154337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 825/1666] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 19 21:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:44:26.166531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 842/1667] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:26.185521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:26.185521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:26.185521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:26.257092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] MFA Rules not processed for user `40b920b115454a708a14a62ead99eccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:26.261267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:26.283826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 826/1668] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:44:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:26.387925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:26.389753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:26.415820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939d991-fe21-46c4-b568-62803f8c6a62 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:26.420921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:26.423060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:26.424118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:26.424641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:26.425117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:26.445607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:26.447468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:26.464497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 843/1669] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:26.598115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:26.600179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:26.628698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:26.652595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1df28-9465-4395-8083-e7a36207bfc5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:26.676079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:26.676869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:26.677152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:26.681290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] PATH_INFO: `/v3/projects/fcbe188b019b4c1aae20067569f249bf` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:26.689945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbe188b019b4c1aae20067569f249bf)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:26.689945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 21:44:26.689945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: warnings.warn(msg) May 19 21:44:26.689945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: May 19 21:44:26.691049 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:26.778885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:26.780462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:26.891064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbe188b019b4c1aae20067569f249bf', 'request_id': 'req-7c59e4e4-7679-4714-aaf5-500b0053d541'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:26.898203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384795f-dccf-417e-88cc-0aeed7b2473d service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:26.899880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbe188b019b4c1aae20067569f249bf', 'request_id': 'req-7c59e4e4-7679-4714-aaf5-500b0053d541'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.002735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:27.003471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:27.003754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:27.003891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbe188b019b4c1aae20067569f249bf', 'request_id': 'req-7c59e4e4-7679-4714-aaf5-500b0053d541'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.004046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:27.006662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:27.043116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] The token cache is being invalidate because project fcbe188b019b4c1aae20067569f249bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:27.043407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.045654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.052889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 827/1670] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:26 2022] DELETE /identity/v3/projects/fcbe188b019b4c1aae20067569f249bf => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:27.054976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:27.058127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:27.185717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:27.187813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:27.219045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 844/1671] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:27.220029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:27.225986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:27.244719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59e4e4-7679-4714-aaf5-500b0053d541 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:27.269010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:27.272147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:27.272670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:27.273775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] PATH_INFO: `/v3/users/0997bec568204210865b8542cd397bbb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:27.281307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411a28-551e-4c73-8297-e18f0031d4d7 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:27.291931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0997bec568204210865b8542cd397bbb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:27.295887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:27.296786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:27.297075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:27.297357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] PATH_INFO: `/v3/projects/06eaad19610a4b4aaf747a2bb971e5dd` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:27.299605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:27.300843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06eaad19610a4b4aaf747a2bb971e5dd)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:27.302999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:27.563429 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06eaad19610a4b4aaf747a2bb971e5dd', 'request_id': 'req-1497bcaf-ddbb-4941-b07b-5af451b751d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.580298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0997bec568204210865b8542cd397bbb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.581870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06eaad19610a4b4aaf747a2bb971e5dd', 'request_id': 'req-1497bcaf-ddbb-4941-b07b-5af451b751d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.607764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0997bec568204210865b8542cd397bbb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.689642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06eaad19610a4b4aaf747a2bb971e5dd', 'request_id': 'req-1497bcaf-ddbb-4941-b07b-5af451b751d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.710290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] The token cache is being invalidate because project 06eaad19610a4b4aaf747a2bb971e5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:27.710549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.711485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1497bcaf-ddbb-4941-b07b-5af451b751d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.717459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 845/1672] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:27 2022] DELETE /identity/v3/projects/06eaad19610a4b4aaf747a2bb971e5dd => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:27.721003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a88b-ef64-487f-b95c-368ced2efc37 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:27.721003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a88b-ef64-487f-b95c-368ced2efc37 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:27.721003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a88b-ef64-487f-b95c-368ced2efc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:27.771108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0997bec568204210865b8542cd397bbb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.780759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-25e3a88b-ef64-487f-b95c-368ced2efc37 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:27.785710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-25e3a88b-ef64-487f-b95c-368ced2efc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:27.834929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0997bec568204210865b8542cd397bbb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.843301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7824306-8576-410f-a060-5a407f0f9eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0997bec568204210865b8542cd397bbb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:27.879298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 828/1673] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:27 2022] DELETE /identity/v3/users/0997bec568204210865b8542cd397bbb => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:27.881313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd853490-3557-41c1-a7c8-77f5d238a2b2 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:27.881802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd853490-3557-41c1-a7c8-77f5d238a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:27.883143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd853490-3557-41c1-a7c8-77f5d238a2b2 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:27.884724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 829/1674] 10.222.0.59 () {54 vars in 960 bytes} [Thu May 19 21:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:27.894969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010de06-90bc-4ccc-a7a8-6c83dd804c02 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:27.895991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010de06-90bc-4ccc-a7a8-6c83dd804c02 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:27.895991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010de06-90bc-4ccc-a7a8-6c83dd804c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:27.943056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0010de06-90bc-4ccc-a7a8-6c83dd804c02 None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:27.945260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0010de06-90bc-4ccc-a7a8-6c83dd804c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:28.034562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 846/1675] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:28.040020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3c423-0f7b-4788-8905-8b4e7ff61aec None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:28.040309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3c423-0f7b-4788-8905-8b4e7ff61aec None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:28.040586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3c423-0f7b-4788-8905-8b4e7ff61aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:28.086155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-dfe3c423-0f7b-4788-8905-8b4e7ff61aec None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:28.087399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-dfe3c423-0f7b-4788-8905-8b4e7ff61aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:28.124421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 830/1676] 10.222.0.59 () {58 vars in 1057 bytes} [Thu May 19 21:44:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:28.127821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:28.132917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010de06-90bc-4ccc-a7a8-6c83dd804c02 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:28.162562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010de06-90bc-4ccc-a7a8-6c83dd804c02 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:28.177647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:28.181145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:28.181559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:28.181943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:28.188491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:28.232250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:28.237232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:28.309731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 831/1677] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:28.321867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:28.325657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 847/1678] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:28.338131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f323c87-b8fd-4fb0-8a31-65ee587a1224 service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:28.345080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:28.347080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:28.347518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:28.353046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:28.353046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:28.353046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:28.353046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:28.373258 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 832/1679] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:44:28.373568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3c423-0f7b-4788-8905-8b4e7ff61aec None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:28.392333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3c423-0f7b-4788-8905-8b4e7ff61aec None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:28.402850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:28.406325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:28.406691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:28.407048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:28.407872 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:28.413102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:28.531237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 848/1680] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:28 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:28.535690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:28.552985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d77c2f-f33a-49a0-b7d2-aac67a0158cf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:28.742501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:28.743201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:28.744032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:28.744333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:28.745082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:28.747023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:28.837976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:28.876220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 833/1681] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:28 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:28.877615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:28.893152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b3280-74ec-4a09-a32c-660b3c51e393 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:28.925114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:28.925946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:28.926352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:28.926716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:28.927667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:28.937975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:28.993489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 849/1682] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:44:28.996317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:29.014168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261536cb-da13-4dd3-994a-4df711f8fe79 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:29.041071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e35a2-0e1a-448e-bbae-0b5f6c2b3d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:29.041771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e35a2-0e1a-448e-bbae-0b5f6c2b3d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:29.042289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e35a2-0e1a-448e-bbae-0b5f6c2b3d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:29.042642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e35a2-0e1a-448e-bbae-0b5f6c2b3d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:29.043381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e35a2-0e1a-448e-bbae-0b5f6c2b3d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:29.045014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e35a2-0e1a-448e-bbae-0b5f6c2b3d40 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:29.082860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:29.094358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 834/1683] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:29.096760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44fb3d-ffb1-4eac-8748-e5e9e61ab235 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:29.110645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:29.113512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:29.113512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:29.113512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] PATH_INFO: `/v3/projects/7430d200f57448baaaea2d953a9a42e5/users/4bc43da648f64a468dc46bf61220deb3/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:29.488506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7430d200f57448baaaea2d953a9a42e5, user_id=4bc43da648f64a468dc46bf61220deb3, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:29.499331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:29.598283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3959dc-63d0-4e2d-8639-eb84a85c38b6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:29.598636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3959dc-63d0-4e2d-8639-eb84a85c38b6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:29.602859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3959dc-63d0-4e2d-8639-eb84a85c38b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:29.609137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 850/1684] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:29 2022] PUT /identity/v3/projects/7430d200f57448baaaea2d953a9a42e5/users/4bc43da648f64a468dc46bf61220deb3/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:29.609304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:29.672470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-da3959dc-63d0-4e2d-8639-eb84a85c38b6 None None] MFA Rules not processed for user `4bc43da648f64a468dc46bf61220deb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:29.675903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-da3959dc-63d0-4e2d-8639-eb84a85c38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:29.875558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:29.877270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 835/1685] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:44:30.031452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484d3fb-2bdd-4440-b6dc-3b3d79264936 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:30.042178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:30.043279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:30.043761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:30.044230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:30.045136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:30.047457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:30.227811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 851/1686] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:29 2022] POST /identity/v3/projects => generated 363 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:44:30.231998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3959dc-63d0-4e2d-8639-eb84a85c38b6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:30.247128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3959dc-63d0-4e2d-8639-eb84a85c38b6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:30.520266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:30.523798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:30.524879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:30.525230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:30.525966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:30.534756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:30.640621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:30.651461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 836/1687] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:30 2022] POST /identity/v3/users => generated 288 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:30.663683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:30.694590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc164-e366-4276-92af-5eb001050989 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:30.705289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:30.706048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:30.706537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:30.714625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:30.714625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:30.714625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:30.728143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 852/1688] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:30.729587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:30.758659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea110-ad24-472e-a972-a0a6d6f14e40 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:30.800243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:30.801488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:30.802069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:30.806384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] PATH_INFO: `/v3/projects/e6a9e67c47b3487ba7fb21da046cbc7c/users/d3da6f613a23474c9bb469ef2a8a5b12/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:30.853484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a9e67c47b3487ba7fb21da046cbc7c, user_id=d3da6f613a23474c9bb469ef2a8a5b12, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:30.863072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:30.948695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 837/1689] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:30 2022] PUT /identity/v3/projects/e6a9e67c47b3487ba7fb21da046cbc7c/users/d3da6f613a23474c9bb469ef2a8a5b12/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:30.952920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:30.973764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383e12c-c16b-4626-b8a6-c66c5504d0dc admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:31.157653 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:31.158655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:31.162624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:31.163736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:31.164902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:31.168428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:31.223401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:31.243549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 853/1690] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:31.244566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:31.246064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2590925-10ac-4a76-aae5-3b0cf7bbc9d5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:31.249956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:31.276148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37bf4-3a9f-4719-b931-50e7c87e5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:31.277075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37bf4-3a9f-4719-b931-50e7c87e5a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:31.277364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37bf4-3a9f-4719-b931-50e7c87e5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:31.277658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37bf4-3a9f-4719-b931-50e7c87e5a83 admin admin] PATH_INFO: `/v3/projects/e6a9e67c47b3487ba7fb21da046cbc7c/users/d3da6f613a23474c9bb469ef2a8a5b12/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:31.281539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37bf4-3a9f-4719-b931-50e7c87e5a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a9e67c47b3487ba7fb21da046cbc7c, user_id=d3da6f613a23474c9bb469ef2a8a5b12, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:31.286020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37bf4-3a9f-4719-b931-50e7c87e5a83 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:31.291210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c81958-9eea-4070-8f75-a8f0bf67fc6a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:31.300234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:31.301372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:31.301757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:31.302132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] PATH_INFO: `/v3/projects/4757c517a2d04e6bbb331ca35319e427` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:31.306058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4757c517a2d04e6bbb331ca35319e427)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:31.327125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:31.348928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 838/1691] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:31 2022] PUT /identity/v3/projects/e6a9e67c47b3487ba7fb21da046cbc7c/users/d3da6f613a23474c9bb469ef2a8a5b12/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:31.348928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:31.348928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:31.348928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:31.407379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] MFA Rules not processed for user `d3da6f613a23474c9bb469ef2a8a5b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:31.408936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:31.575856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4757c517a2d04e6bbb331ca35319e427', 'request_id': 'req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:31.623652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4757c517a2d04e6bbb331ca35319e427', 'request_id': 'req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:31.779266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4757c517a2d04e6bbb331ca35319e427', 'request_id': 'req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:31.810680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] The token cache is being invalidate because project 4757c517a2d04e6bbb331ca35319e427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:31.811017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:31.819856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-00e7ee2d-68b0-4b55-afe1-f5d431400ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:31.833607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 854/1692] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:31 2022] DELETE /identity/v3/projects/4757c517a2d04e6bbb331ca35319e427 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:31.839307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cbfee-12a6-4980-9671-319008e06fbf None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:31.841872 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cbfee-12a6-4980-9671-319008e06fbf None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:31.842250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cbfee-12a6-4980-9671-319008e06fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:31.938275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ba0cbfee-12a6-4980-9671-319008e06fbf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:31.940305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ba0cbfee-12a6-4980-9671-319008e06fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:32.121822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 855/1693] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:32.134924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e0b5-8f9d-4dba-a9b0-ae767b3f1519 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:32.135497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e0b5-8f9d-4dba-a9b0-ae767b3f1519 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:32.136122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e0b5-8f9d-4dba-a9b0-ae767b3f1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:32.191827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-58a4e0b5-8f9d-4dba-a9b0-ae767b3f1519 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:32.194777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-58a4e0b5-8f9d-4dba-a9b0-ae767b3f1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:32.219760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 856/1694] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:32.223960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e0b5-8f9d-4dba-a9b0-ae767b3f1519 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:32.245574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e0b5-8f9d-4dba-a9b0-ae767b3f1519 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:32.256105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:32.256811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:32.257096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:32.257403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:32.262276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:32.264704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:32.268338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:32.268899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 839/1695] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 920 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:32.276051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:32.295049 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:32.296235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 857/1696] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:32.300722 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:32.347264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cd420-9cc2-49b2-af5b-9d8a895f7efe admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:32.366736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:32.367780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:32.368215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:32.368676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:32.369545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:32.375064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:32.429441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:32.475953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fff602-0a14-4f0c-9aca-b5f697b74024 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:32.567890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 858/1697] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:32 2022] POST /identity/v3/projects => generated 405 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:44:32.569703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:32.663027 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:32.665816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:32.665816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:32.665816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:32.924451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:32.925769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a6395-e9e0-40f3-afbc-652605dfe81f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:32.945561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:32.948069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:32.948249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:32.948425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:32.949143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:32.951151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:32.973648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:33.003784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:33.052532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 840/1698] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:33.086642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 859/1699] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:32 2022] POST /identity/v3/users => generated 303 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:33.090033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:33.111391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fd716-ac7b-4ee6-9c1e-7e268fb98395 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:33.119966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:33.124508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:33.124508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:33.124508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:33.124508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:33.125274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:33.161792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 841/1700] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:33.171152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:33.192535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ac1de-774c-4294-992e-eb9f5103f24f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:33.220956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9bd2-d72e-4fd3-b4bc-ab80f0000590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:33.221652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9bd2-d72e-4fd3-b4bc-ab80f0000590 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:33.221933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9bd2-d72e-4fd3-b4bc-ab80f0000590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:33.222205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9bd2-d72e-4fd3-b4bc-ab80f0000590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:33.222955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9bd2-d72e-4fd3-b4bc-ab80f0000590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:33.224632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9bd2-d72e-4fd3-b4bc-ab80f0000590 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:33.272998 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 860/1701] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:33.276440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:33.295791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e2a56-9c12-4c84-82be-f6cbf70c985c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:33.302688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:33.303752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:33.304173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:33.304614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] PATH_INFO: `/v3/projects/fd48428b48a74d93a48edd754bc786b3/users/d92edbbe67d549c0ab452abdb8cde1d7/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:33.337607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf1430-12ca-47cd-8b90-8f074827765e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:33.346163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf1430-12ca-47cd-8b90-8f074827765e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:33.346719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf1430-12ca-47cd-8b90-8f074827765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:33.369214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd48428b48a74d93a48edd754bc786b3, user_id=d92edbbe67d549c0ab452abdb8cde1d7, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:33.375372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:33.401371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fecf1430-12ca-47cd-8b90-8f074827765e None None] MFA Rules not processed for user `bafd0e09a6134be080a352b63d867356`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:33.403150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fecf1430-12ca-47cd-8b90-8f074827765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:33.508908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 842/1702] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:33 2022] PUT /identity/v3/projects/fd48428b48a74d93a48edd754bc786b3/users/d92edbbe67d549c0ab452abdb8cde1d7/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:33.508908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:33.514275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:33.565343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 861/1703] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:33.569508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff432db-5f2f-48f9-a577-6bd5c06601bc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:33.569956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff432db-5f2f-48f9-a577-6bd5c06601bc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:33.570425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff432db-5f2f-48f9-a577-6bd5c06601bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:33.612667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8ff432db-5f2f-48f9-a577-6bd5c06601bc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:33.616106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8ff432db-5f2f-48f9-a577-6bd5c06601bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:33.719531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d25278-3530-4fa5-8489-5290b1d423c9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:33.725123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:33.727466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:33.727752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:33.728098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:33.740222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:33.833446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 862/1704] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:33.838086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:33.839153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:33.839572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:33.879180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] MFA Rules not processed for user `bafd0e09a6134be080a352b63d867356`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:33.881332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:33.887314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:33.889903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:33.937695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 843/1705] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:33.941535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:33.945723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:34.072677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:34.132701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 863/1706] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:34.151662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:34.153301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:34.190917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a48c8a-b895-411f-9b15-3f46528d7c24 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:34.200758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12113c-f88d-4293-a3d6-a449d0480863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:34.201683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12113c-f88d-4293-a3d6-a449d0480863 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:34.202138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12113c-f88d-4293-a3d6-a449d0480863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:34.203640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12113c-f88d-4293-a3d6-a449d0480863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:34.235033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12113c-f88d-4293-a3d6-a449d0480863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:34.243612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12113c-f88d-4293-a3d6-a449d0480863 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:34.289890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 844/1707] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:34.328020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:34.442535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd5f2-a4f6-4890-ae65-6a436978bb7c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:34.501694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:34.502910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:34.503225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:34.503550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:34.519742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:34.521421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:34.538976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 864/1708] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:34.562323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cbb61-3112-43c2-9255-10a2f22dc318 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:34.566088 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cbb61-3112-43c2-9255-10a2f22dc318 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:34.566585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cbb61-3112-43c2-9255-10a2f22dc318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:34.620467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-677cbb61-3112-43c2-9255-10a2f22dc318 None None] MFA Rules not processed for user `5205045922ca4dab8d556845be5f574b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:34.634694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-677cbb61-3112-43c2-9255-10a2f22dc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:34.665611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:34.694327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d6e45-ad1e-42e9-922e-7f626e44b958 service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:34.719166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:34.722068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:34.723494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:34.724540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:34.745356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:34.909403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 845/1709] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:34.926440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:34.939320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:34.939320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:34.961725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:34.963255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:34.970820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:34.970820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:34.985539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 865/1710] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:44:35.124889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 846/1711] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:44:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:44:35.393598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:35.395330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:35.425940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140774d8-4319-4880-86b5-40a5697aaeb6 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:35.439531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:35.442844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:35.449883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:35.449883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] PATH_INFO: `/v3/users/596d85b923064caeada31792c6883c57` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:35.453710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=596d85b923064caeada31792c6883c57)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:35.456277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:35.523428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:35.590596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:35.592302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:35.648882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27c0e-f589-4a24-a5ef-4dc3363d2ecf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:35.666015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:35.666015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:35.666015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:35.666015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:35.683128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:35.686687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:35.711506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 847/1712] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:44:35.719362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:35.725618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:35.821505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596d85b923064caeada31792c6883c57'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:35.831258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596d85b923064caeada31792c6883c57'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:35.833343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596d85b923064caeada31792c6883c57'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:35.837000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596d85b923064caeada31792c6883c57'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:35.898385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef830-c34a-4ab8-b48a-f8f579b50eef service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:35.903886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0e31-7dfd-4e36-bed3-82acf06a3bb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:35.904555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0e31-7dfd-4e36-bed3-82acf06a3bb0 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:35.904838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0e31-7dfd-4e36-bed3-82acf06a3bb0 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:35.905116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0e31-7dfd-4e36-bed3-82acf06a3bb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:35.907032 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-065c0e31-7dfd-4e36-bed3-82acf06a3bb0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:35.919161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c0e31-7dfd-4e36-bed3-82acf06a3bb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:35.920988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c0e31-7dfd-4e36-bed3-82acf06a3bb0 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:35.932906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 848/1713] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:44:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:44:35.947089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a70cc64-bfc2-4cfa-bbd6-5fd6c80127ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596d85b923064caeada31792c6883c57'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:35.960772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:35.961046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:35.961274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:36.008479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 866/1714] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:35 2022] DELETE /identity/v3/users/596d85b923064caeada31792c6883c57 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:36.010064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:36.010478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:36.010701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:36.053576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:36.055203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:36.072041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] MFA Rules not processed for user `102a611e510d4087b09bf7206c2d302a`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:36.073583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:36.311159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 867/1715] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:36.318491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 849/1716] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:36.334185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:36.335946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:36.367808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:36.369260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:36.595575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23016a39-c7c8-4eb8-b0ec-b9c4f6e0ad09 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:36.639284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2429c5-aff0-4c42-8473-ed4b1d410370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:36.639999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2429c5-aff0-4c42-8473-ed4b1d410370 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:36.640411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2429c5-aff0-4c42-8473-ed4b1d410370 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:36.648007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2429c5-aff0-4c42-8473-ed4b1d410370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:36.687696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f09827-8063-492a-ac3d-46e53dd079f8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:36.706792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2429c5-aff0-4c42-8473-ed4b1d410370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:36.714557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd510331-26c4-49ae-bc77-ed7801fb9e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:36.715238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510331-26c4-49ae-bc77-ed7801fb9e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:36.721568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2429c5-aff0-4c42-8473-ed4b1d410370 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:36.722060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510331-26c4-49ae-bc77-ed7801fb9e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:36.723594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510331-26c4-49ae-bc77-ed7801fb9e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:36.735135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:36.757726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:36.782335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd510331-26c4-49ae-bc77-ed7801fb9e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:36.786623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 868/1717] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:36.794802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd510331-26c4-49ae-bc77-ed7801fb9e81 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:36.837556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 850/1718] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:37.539164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354c92-1429-4fb4-8a44-dd8ca25590bb None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:37.539164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354c92-1429-4fb4-8a44-dd8ca25590bb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:37.539164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7354c92-1429-4fb4-8a44-dd8ca25590bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:37.731491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c7354c92-1429-4fb4-8a44-dd8ca25590bb None None] MFA Rules not processed for user `bafd0e09a6134be080a352b63d867356`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:37.731491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c7354c92-1429-4fb4-8a44-dd8ca25590bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:37.731491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 869/1719] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:37.836515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:38.908552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865b89-9b56-4bf2-ade5-5135f6e8bc45 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:38.909051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865b89-9b56-4bf2-ade5-5135f6e8bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:38.909139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865b89-9b56-4bf2-ade5-5135f6e8bc45 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:38.923333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 851/1720] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 19 21:44:38 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:38.952911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2395-166b-469d-89d8-0a8ac464b70d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:38.953313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2395-166b-469d-89d8-0a8ac464b70d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:38.953493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2395-166b-469d-89d8-0a8ac464b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:39.047117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-2dfa2395-166b-469d-89d8-0a8ac464b70d None None] MFA Rules not processed for user `40b920b115454a708a14a62ead99eccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:39.052962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2dfa2395-166b-469d-89d8-0a8ac464b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:39.086489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 870/1721] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:44:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:39.130926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75865b89-9b56-4bf2-ade5-5135f6e8bc45 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:39.133271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-75865b89-9b56-4bf2-ade5-5135f6e8bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:39.180938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75865b89-9b56-4bf2-ade5-5135f6e8bc45 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:39.200446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:39.200747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:39.201238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:39.214645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:39.215635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:39.216262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:39.216794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:39.245276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] MFA Rules not processed for user `40b920b115454a708a14a62ead99eccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:39.246332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:39.246950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:39.252897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:39.269026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 871/1722] 10.222.0.97 () {58 vars in 1015 bytes} [Thu May 19 21:44:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:39.313737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 852/1723] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:39.338269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:39.340420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:39.363358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:39.378784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ecd8-bbc8-4458-ac93-6b5ac18454a4 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:39.390959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:39.394942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:39.394942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:39.394942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:39.411424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9d51b-d929-4373-8027-523305f0310e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:39.422685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:39.429427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:39.432722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:39.432968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:39.433275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] PATH_INFO: `/v3/projects/10ef2894c29c4720855ab8137a7ce757` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:39.435528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:39.441733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ef2894c29c4720855ab8137a7ce757)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:39.446304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:39.467836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 853/1724] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:44:39.533455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:39.535527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:39.620365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3ce11-49df-43cd-bad5-b7eb455cd18b service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:39.649647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:39.650566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:39.653640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:39.653640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] PATH_INFO: `/v3/users/4bc43da648f64a468dc46bf61220deb3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:39.654419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc43da648f64a468dc46bf61220deb3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:39.658774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:39.766186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ef2894c29c4720855ab8137a7ce757', 'request_id': 'req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:39.797407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ef2894c29c4720855ab8137a7ce757', 'request_id': 'req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:39.928428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ef2894c29c4720855ab8137a7ce757', 'request_id': 'req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:39.959833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] The token cache is being invalidate because project 10ef2894c29c4720855ab8137a7ce757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:39.960839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:39.965130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:39.968268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 872/1725] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:39 2022] DELETE /identity/v3/projects/10ef2894c29c4720855ab8137a7ce757 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:39.973973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:39.979621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:40.003757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc43da648f64a468dc46bf61220deb3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.036712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc43da648f64a468dc46bf61220deb3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.141380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdc145-ab76-4c78-8e65-4ae9e0c92f54 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:40.151908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc43da648f64a468dc46bf61220deb3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.156933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:40.158993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:40.167021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:40.167021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] PATH_INFO: `/v3/users/4ab064ce4a98438094f53e1e1d5d7edf` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:40.167021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab064ce4a98438094f53e1e1d5d7edf)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:40.167021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:40.182738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc43da648f64a468dc46bf61220deb3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.186730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-95c2267b-2bd8-4030-ad02-f81e67186334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc43da648f64a468dc46bf61220deb3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.226628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 854/1726] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:39 2022] DELETE /identity/v3/users/4bc43da648f64a468dc46bf61220deb3 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:40.231020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321153a-b3bc-462d-b94a-3474c906dc66 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:40.231587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321153a-b3bc-462d-b94a-3474c906dc66 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:40.233361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321153a-b3bc-462d-b94a-3474c906dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:40.317599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5321153a-b3bc-462d-b94a-3474c906dc66 None None] MFA Rules not processed for user `d92edbbe67d549c0ab452abdb8cde1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:40.332480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5321153a-b3bc-462d-b94a-3474c906dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:40.553538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab064ce4a98438094f53e1e1d5d7edf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.562104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab064ce4a98438094f53e1e1d5d7edf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.562864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab064ce4a98438094f53e1e1d5d7edf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.566956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab064ce4a98438094f53e1e1d5d7edf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.604160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 855/1727] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:40.605818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:40.607170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:40.607551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:40.644336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:40.647298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab064ce4a98438094f53e1e1d5d7edf'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:40.648705 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:40.724208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:40.744013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:40.789960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 873/1728] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:39 2022] DELETE /identity/v3/users/4ab064ce4a98438094f53e1e1d5d7edf => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:40.789960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:40.798763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:40.877881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 856/1729] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:40.945713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:40.947845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:41.068700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc051605-1a85-4949-833b-72c09c52d90e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:41.086375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:41.087088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:41.087372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:41.087647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:41.089352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:41.096268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:41.162813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092904b2-2f9d-4879-8416-79b6c0d110c6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:41.236135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:41.236923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:41.238107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:41.238393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:41.264983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:41.268410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:41.281581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 857/1730] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:44:41.332641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 874/1731] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:40 2022] POST /identity/v3/projects => generated 405 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:41.336383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:41.347906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1b9cf-1e99-45ae-9348-ff564a0f288b service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:41.643275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:41.643973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:41.644257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:41.644532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:41.645249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:41.649735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:41.837228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 858/1732] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:41 2022] POST /identity/v3/users => generated 309 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:41.838408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:41.876054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0322-bfb4-443b-9840-6acdd4e160ed admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:41.898148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:41.899024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:41.899398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:41.899748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:41.902030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:41.932357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:41.964071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:41.967634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 875/1733] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:44:41.971039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:41.974449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:41.984408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02d913-482f-4e7e-b031-cca37881f4a0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:42.021176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d62a1-9789-4cbe-b389-9b17122b18f1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:42.022921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:42.025613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:42.025908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:42.029197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] PATH_INFO: `/v3/projects/9b645f96779b4d19ab5b45d5aed137ba/users/902514d2379c40fe829ecd516f55e9ba/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:42.040198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:42.041365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:42.041860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:42.042421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] PATH_INFO: `/v3/users/ef1f9cade74c44f590b737935dd59206` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:42.043975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1f9cade74c44f590b737935dd59206)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:42.046393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:42.135343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b645f96779b4d19ab5b45d5aed137ba, user_id=902514d2379c40fe829ecd516f55e9ba, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:42.150680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:42.251844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 859/1734] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:41 2022] PUT /identity/v3/projects/9b645f96779b4d19ab5b45d5aed137ba/users/902514d2379c40fe829ecd516f55e9ba/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:42.254458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:42.451217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1f9cade74c44f590b737935dd59206'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:42.468471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1f9cade74c44f590b737935dd59206'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:42.473485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1f9cade74c44f590b737935dd59206'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:42.475675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1f9cade74c44f590b737935dd59206'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:42.478616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a8d0-34a0-4818-86e7-b483762ddb0e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:42.494354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:42.495055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:42.495339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:42.495618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:42.496354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:42.497987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:42.538167 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 860/1735] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:42.549060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:42.553615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:42.594104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a320-4e00-48ff-a318-5681c1803891 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:42.612520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1575508b-672c-48ad-9c9c-265a8dbfc5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1f9cade74c44f590b737935dd59206'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:42.651226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:42.652150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:42.652424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:42.652706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] PATH_INFO: `/v3/projects/9b645f96779b4d19ab5b45d5aed137ba/users/902514d2379c40fe829ecd516f55e9ba/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:42.656921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b645f96779b4d19ab5b45d5aed137ba, user_id=902514d2379c40fe829ecd516f55e9ba, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:42.659994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:42.669089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 876/1736] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:41 2022] DELETE /identity/v3/users/ef1f9cade74c44f590b737935dd59206 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:42.670671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:42.673730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:42.673730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:42.695767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:42.724129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:42.725462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:42.734774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 861/1737] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:42 2022] PUT /identity/v3/projects/9b645f96779b4d19ab5b45d5aed137ba/users/902514d2379c40fe829ecd516f55e9ba/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:42.931995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 877/1738] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:43.088758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:43.091853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:43.300051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919769b-c90c-4d61-9605-d05c90540647 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:43.312228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:43.312886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:43.313176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:43.329738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:43.357320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:43.361104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:43.403969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 862/1739] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:43.452807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:43.453785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:43.482043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19b10b-92bc-418b-a7d5-116db2b381f9 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:43.509028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:43.511296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:43.511863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:43.512326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] PATH_INFO: `/v3/projects/7430d200f57448baaaea2d953a9a42e5` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:43.518869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7430d200f57448baaaea2d953a9a42e5)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:43.524802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:43.622030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:43.623280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:43.664014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dea8d8-b41c-4abe-9f2e-6c6eedb8af9c service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:43.687133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:43.688108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:43.688306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:43.688618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] PATH_INFO: `/v3/projects/0a220e6207dd4993baafcf225de4175d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:43.709416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a220e6207dd4993baafcf225de4175d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:43.711576 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:43.769674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7430d200f57448baaaea2d953a9a42e5', 'request_id': 'req-d8416b38-b874-4b07-946f-a6af295e41c8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:43.805368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7430d200f57448baaaea2d953a9a42e5', 'request_id': 'req-d8416b38-b874-4b07-946f-a6af295e41c8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:43.956736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7430d200f57448baaaea2d953a9a42e5', 'request_id': 'req-d8416b38-b874-4b07-946f-a6af295e41c8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.001540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] The token cache is being invalidate because project 7430d200f57448baaaea2d953a9a42e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:44.001841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.007419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.017179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 878/1740] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:43 2022] DELETE /identity/v3/projects/7430d200f57448baaaea2d953a9a42e5 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:44.018204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:44.025790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:44.030482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a220e6207dd4993baafcf225de4175d', 'request_id': 'req-cc3dc079-3630-49dd-b2c6-67a7ac717305'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.053194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a220e6207dd4993baafcf225de4175d', 'request_id': 'req-cc3dc079-3630-49dd-b2c6-67a7ac717305'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.073340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:44.204379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a220e6207dd4993baafcf225de4175d', 'request_id': 'req-cc3dc079-3630-49dd-b2c6-67a7ac717305'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.245097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] The token cache is being invalidate because project 0a220e6207dd4993baafcf225de4175d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:44.246650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.247556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc3dc079-3630-49dd-b2c6-67a7ac717305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.253608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 863/1741] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:43 2022] DELETE /identity/v3/projects/0a220e6207dd4993baafcf225de4175d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:44.260206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786023f5-2638-4e44-8e6d-599448494113 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:44.261872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786023f5-2638-4e44-8e6d-599448494113 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:44.262165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786023f5-2638-4e44-8e6d-599448494113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:44.273932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8416b38-b874-4b07-946f-a6af295e41c8 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:44.305772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-786023f5-2638-4e44-8e6d-599448494113 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:44.308305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-786023f5-2638-4e44-8e6d-599448494113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:44.396823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 864/1742] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:44.414414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab22e5-db0d-4eac-a723-c33685e9312c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:44.418961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab22e5-db0d-4eac-a723-c33685e9312c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:44.419468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab22e5-db0d-4eac-a723-c33685e9312c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:44.474282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d1ab22e5-db0d-4eac-a723-c33685e9312c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:44.479474 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1ab22e5-db0d-4eac-a723-c33685e9312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:44.512778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 865/1743] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:44.515472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99fa-8c15-46c7-9037-6ab86d789455 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:44.515969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99fa-8c15-46c7-9037-6ab86d789455 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:44.520703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99fa-8c15-46c7-9037-6ab86d789455 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:44.521904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 866/1744] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:44:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:44.523131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d99fa-8c15-46c7-9037-6ab86d789455 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:44.530543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:44.532920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:44.533785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:44.534148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] PATH_INFO: `/v3/users/d3da6f613a23474c9bb469ef2a8a5b12` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:44.546344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3da6f613a23474c9bb469ef2a8a5b12)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:44.549489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:44.555646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d99fa-8c15-46c7-9037-6ab86d789455 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:44.569434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:44.570510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:44.571537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:44.571943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:44.574273 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:44.576588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:44.578351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:44.616216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 867/1745] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:44.617451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:44.632057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d66411-cd35-4f1c-aa07-669f04d5e18d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:44.650279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096f816-0373-4c0d-8f47-847bbab5b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:44.650977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f816-0373-4c0d-8f47-847bbab5b5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:44.651289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f816-0373-4c0d-8f47-847bbab5b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:44.651544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f816-0373-4c0d-8f47-847bbab5b5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:44.652853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096f816-0373-4c0d-8f47-847bbab5b5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:44.655105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096f816-0373-4c0d-8f47-847bbab5b5fb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:44.753712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3da6f613a23474c9bb469ef2a8a5b12'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.771160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3da6f613a23474c9bb469ef2a8a5b12'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.776609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3da6f613a23474c9bb469ef2a8a5b12'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.780407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3da6f613a23474c9bb469ef2a8a5b12'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.789976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 868/1746] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:44.793806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442a12-7d04-46cf-9c0a-66f5df37b046 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:44.794101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442a12-7d04-46cf-9c0a-66f5df37b046 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:44.794490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442a12-7d04-46cf-9c0a-66f5df37b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:44.861352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3da6f613a23474c9bb469ef2a8a5b12'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:44.877998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-de442a12-7d04-46cf-9c0a-66f5df37b046 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:44.887424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-de442a12-7d04-46cf-9c0a-66f5df37b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:44.904874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 879/1747] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:44 2022] DELETE /identity/v3/users/d3da6f613a23474c9bb469ef2a8a5b12 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:44.904874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:44.935239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:45.089444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346eb1c-c518-4ab8-b141-333599403442 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:45.102945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:45.103779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:45.105056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:45.107791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:45.108571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:45.122761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:45.176992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 869/1748] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:44:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:45.322732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 880/1749] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:44 2022] POST /identity/v3/users => generated 293 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:45.326932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de442a12-7d04-46cf-9c0a-66f5df37b046 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:45.437541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:45.476037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de442a12-7d04-46cf-9c0a-66f5df37b046 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:45.492645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:45.493583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:45.494016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:45.494575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:45.495638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:45.497788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:45.528933 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 870/1750] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:45.532903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:45.551805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:45.557854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc6436-dafd-4249-b821-bd418595b59b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:45.576296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa70abd-9c6f-42cc-8748-0b2c8ee42a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:45.576943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70abd-9c6f-42cc-8748-0b2c8ee42a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:45.577232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70abd-9c6f-42cc-8748-0b2c8ee42a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:45.577643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70abd-9c6f-42cc-8748-0b2c8ee42a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:45.578471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa70abd-9c6f-42cc-8748-0b2c8ee42a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:45.580330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa70abd-9c6f-42cc-8748-0b2c8ee42a4f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:45.618783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 881/1751] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:45.622895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:45.650940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7194a68-c50b-4d9c-8f3c-402f241916f6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:45.662178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:45.663349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:45.663671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:45.663957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] PATH_INFO: `/v3/projects/0391449b2668449daf1011b069cdb584/users/47f084b231a34294a4b8140228abb269/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:45.741031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0391449b2668449daf1011b069cdb584, user_id=47f084b231a34294a4b8140228abb269, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:45.745708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:45.852017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 871/1752] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:45 2022] PUT /identity/v3/projects/0391449b2668449daf1011b069cdb584/users/47f084b231a34294a4b8140228abb269/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:45.854837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c58d-2791-49f3-95e7-96a8a1e62c1e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:45.855399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c58d-2791-49f3-95e7-96a8a1e62c1e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:45.855822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c58d-2791-49f3-95e7-96a8a1e62c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:45.925697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7569c58d-2791-49f3-95e7-96a8a1e62c1e None None] MFA Rules not processed for user `47f084b231a34294a4b8140228abb269`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:45.936276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7569c58d-2791-49f3-95e7-96a8a1e62c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:45.940482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:45.943884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:46.045902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 882/1753] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:46.052787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c58d-2791-49f3-95e7-96a8a1e62c1e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:46.150411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c58d-2791-49f3-95e7-96a8a1e62c1e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:46.160292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:46.161238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:46.161623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:46.162109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:46.163240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:46.167024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:46.208883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:46.219336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349c09-135a-413b-8c05-ee84027f2cbd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:46.250288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:46.251063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:46.251449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:46.251770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:46.281438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:46.281438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:46.298076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 883/1754] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:46 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:44:46.303305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:46.342788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 872/1755] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:46.413138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:46.513978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad430c6-b580-4318-9313-60e7930c5ceb admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:46.535555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:46.536377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:46.536889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:46.537396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:46.538433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:46.540804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:46.702619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 884/1756] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:46 2022] POST /identity/v3/users => generated 298 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:44:46.707520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:46.727452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a703-fa9a-415d-8f83-022fd255e2f7 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:46.742357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:46.744527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:46.745173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:46.748236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:46.749503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:46.752343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:46.781348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 873/1757] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:46.786087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:46.809602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a3c3-1936-408d-bd93-d6d219f5e686 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:46.829204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:46.832723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:46.832723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:46.832723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] PATH_INFO: `/v3/projects/8f6be5b867704eeab2dbc741fbd7dc6b/users/1d9342eb1889418eb661aa434f880fb4/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:46.889037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6be5b867704eeab2dbc741fbd7dc6b, user_id=1d9342eb1889418eb661aa434f880fb4, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:46.891908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:46.999219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 885/1758] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:46 2022] PUT /identity/v3/projects/8f6be5b867704eeab2dbc741fbd7dc6b/users/1d9342eb1889418eb661aa434f880fb4/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:47.004323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:47.020309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05a219-061d-480a-a1ef-bba0a2c4ca22 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:47.158397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2637016-2fbb-4bca-9e70-9408ebbae22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:47.159091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2637016-2fbb-4bca-9e70-9408ebbae22e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:47.159636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2637016-2fbb-4bca-9e70-9408ebbae22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:47.159917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2637016-2fbb-4bca-9e70-9408ebbae22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:47.160653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2637016-2fbb-4bca-9e70-9408ebbae22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:47.164397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2637016-2fbb-4bca-9e70-9408ebbae22e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:47.198244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 874/1759] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:47.201978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:47.219007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7e21-d0d6-43dd-a2ab-182016b94838 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:47.224619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:47.225671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:47.226058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:47.226520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] PATH_INFO: `/v3/projects/8f6be5b867704eeab2dbc741fbd7dc6b/users/1d9342eb1889418eb661aa434f880fb4/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:47.229028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6be5b867704eeab2dbc741fbd7dc6b, user_id=1d9342eb1889418eb661aa434f880fb4, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:47.232034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:47.276423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 886/1760] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:47 2022] PUT /identity/v3/projects/8f6be5b867704eeab2dbc741fbd7dc6b/users/1d9342eb1889418eb661aa434f880fb4/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:47.278199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524092-82e9-4733-9d18-e983a12d52e9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:47.278523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524092-82e9-4733-9d18-e983a12d52e9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:47.278920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524092-82e9-4733-9d18-e983a12d52e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:47.336605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c0524092-82e9-4733-9d18-e983a12d52e9 None None] MFA Rules not processed for user `1d9342eb1889418eb661aa434f880fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:47.361787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c0524092-82e9-4733-9d18-e983a12d52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:47.418837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:47.486120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 875/1761] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:47.494643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:47.497402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:47.499461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:47.533353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf578a-d360-417f-8725-410470df4c67 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:47.533906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf578a-d360-417f-8725-410470df4c67 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:47.534654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf578a-d360-417f-8725-410470df4c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:47.561653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8cbf578a-d360-417f-8725-410470df4c67 None None] MFA Rules not processed for user `5205045922ca4dab8d556845be5f574b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:47.562946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8cbf578a-d360-417f-8725-410470df4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:47.666030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 876/1762] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:44:47.683478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:47.684065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:47.684612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:47.733964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] MFA Rules not processed for user `102a611e510d4087b09bf7206c2d302a`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:47.739311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:47.744350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a20b-71c0-48af-8696-0314634642c2 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:47.758506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:47.758506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:47.758506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:47.758506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:47.963241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:47.964890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:48.000469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 877/1763] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:48.000469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:48.000469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:48.003311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 887/1764] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:48.159784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:48.162690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:48.238960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d3998-cebe-4332-b3c5-df0d24a829bf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:48.256164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:48.257168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:48.258060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:48.259977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] PATH_INFO: `/v3/projects/33420cd77ce14e4187357e4ebb06420b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:48.262113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33420cd77ce14e4187357e4ebb06420b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:48.274986 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:48.330529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:48.387587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7e2b8-0d24-4a75-aa1f-a567ef230184 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:48.393794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:48.394873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:48.395532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:48.395991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] PATH_INFO: `/v3/projects/e6a9e67c47b3487ba7fb21da046cbc7c` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:48.397477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a9e67c47b3487ba7fb21da046cbc7c)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:48.402033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:48.461880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33420cd77ce14e4187357e4ebb06420b', 'request_id': 'req-1821c472-5ec3-4520-a34a-3e37f3d8d50e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.468675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33420cd77ce14e4187357e4ebb06420b', 'request_id': 'req-1821c472-5ec3-4520-a34a-3e37f3d8d50e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.560694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33420cd77ce14e4187357e4ebb06420b', 'request_id': 'req-1821c472-5ec3-4520-a34a-3e37f3d8d50e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.602625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a9e67c47b3487ba7fb21da046cbc7c', 'request_id': 'req-777aa374-6342-4313-b10c-ee34db01ba34'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.612134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] The token cache is being invalidate because project 33420cd77ce14e4187357e4ebb06420b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:48.613660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.617286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.617453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a9e67c47b3487ba7fb21da046cbc7c', 'request_id': 'req-777aa374-6342-4313-b10c-ee34db01ba34'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.629463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 878/1765] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:47 2022] DELETE /identity/v3/projects/33420cd77ce14e4187357e4ebb06420b => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:48.631878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:48.634063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:48.744356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a9e67c47b3487ba7fb21da046cbc7c', 'request_id': 'req-777aa374-6342-4313-b10c-ee34db01ba34'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.764750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] The token cache is being invalidate because project e6a9e67c47b3487ba7fb21da046cbc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:48.765050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.768855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-777aa374-6342-4313-b10c-ee34db01ba34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:48.783457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 888/1766] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:48 2022] DELETE /identity/v3/projects/e6a9e67c47b3487ba7fb21da046cbc7c => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:44:48.785260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1ca3-adc8-4ed7-8fe3-d7d02d64b60d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:48.785659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1ca3-adc8-4ed7-8fe3-d7d02d64b60d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:48.785984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c1ca3-adc8-4ed7-8fe3-d7d02d64b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:48.814085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c472-5ec3-4520-a34a-3e37f3d8d50e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:48.829146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-887c1ca3-adc8-4ed7-8fe3-d7d02d64b60d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:48.830412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-887c1ca3-adc8-4ed7-8fe3-d7d02d64b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:48.918312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:48.944303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:48.947014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:48.947014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:48.947014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] PATH_INFO: `/v3/users/53553a9eb0fc410cb7eff87ed475be30` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:48.948342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53553a9eb0fc410cb7eff87ed475be30)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:48.950582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:49.091192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 889/1767] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:49.096706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89a1a-639d-4789-867f-fbd326972494 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:49.097107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89a1a-639d-4789-867f-fbd326972494 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:49.098320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89a1a-639d-4789-867f-fbd326972494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:49.145666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-d3a89a1a-639d-4789-867f-fbd326972494 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:49.147214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d3a89a1a-639d-4789-867f-fbd326972494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:49.158195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 890/1768] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:49.162409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89a1a-639d-4789-867f-fbd326972494 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:49.174788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89a1a-639d-4789-867f-fbd326972494 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:49.181700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:49.183272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:49.183663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:49.184062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:49.185045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:49.185453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:49.187319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:49.216242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 891/1769] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:44:49.218121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:49.244174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828a4a-eb77-4993-b3b5-63cfabda0586 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:49.252998 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:49.253958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:49.258149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:49.258149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:49.258149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:49.259391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:49.367356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53553a9eb0fc410cb7eff87ed475be30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:49.370348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:49.385717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53553a9eb0fc410cb7eff87ed475be30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:49.413398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 892/1770] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:49 2022] POST /identity/v3/projects => generated 409 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:49.417700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:49.475591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53553a9eb0fc410cb7eff87ed475be30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:49.506988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53553a9eb0fc410cb7eff87ed475be30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:49.511203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-dfe62684-b472-42b0-8baa-f298a3b952e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53553a9eb0fc410cb7eff87ed475be30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:49.530868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 879/1771] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:48 2022] DELETE /identity/v3/users/53553a9eb0fc410cb7eff87ed475be30 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:49.634791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d574ed0-3750-4c03-99f5-abcedac5d30e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:49.740759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:49.741969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:49.742938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:49.744174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:49.746027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:49.749541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:49.843067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82244ba-a124-4e51-9cf5-33bdb5f58401 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:49.846330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82244ba-a124-4e51-9cf5-33bdb5f58401 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:49.849417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82244ba-a124-4e51-9cf5-33bdb5f58401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:49.905734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 893/1772] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:49 2022] POST /identity/v3/users => generated 305 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:49.912142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:49.916973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:49.925492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d82244ba-a124-4e51-9cf5-33bdb5f58401 None None] MFA Rules not processed for user `902514d2379c40fe829ecd516f55e9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:49.926796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d82244ba-a124-4e51-9cf5-33bdb5f58401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:49.943170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa12d29-c5cf-4486-bd8c-5676211411fa admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:49.952775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:49.954994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:49.955591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:49.956176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:49.957768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:49.960099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:49.983696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 894/1773] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:44:49.989518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:50.024946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05019bc5-712b-4d0c-9139-6513733e9283 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:50.051362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 880/1774] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:50.054774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283940-ab92-47df-9f69-a9bdb27c699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:50.055124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283940-ab92-47df-9f69-a9bdb27c699c admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:50.055509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283940-ab92-47df-9f69-a9bdb27c699c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:50.055795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283940-ab92-47df-9f69-a9bdb27c699c admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:50.056620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283940-ab92-47df-9f69-a9bdb27c699c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:50.059058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283940-ab92-47df-9f69-a9bdb27c699c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:50.078465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 895/1775] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:44:50.081070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82244ba-a124-4e51-9cf5-33bdb5f58401 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:50.093685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82244ba-a124-4e51-9cf5-33bdb5f58401 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:50.103791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:50.103791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:50.103791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:50.103791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] PATH_INFO: `/v3/projects/b6cdcb2d4d6b4e8283047af8b33b02a5/users/c4988e798dbb43fda99d555d848ba866/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:50.145548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cdcb2d4d6b4e8283047af8b33b02a5, user_id=c4988e798dbb43fda99d555d848ba866, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:50.153792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:50.311096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 881/1776] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:50 2022] PUT /identity/v3/projects/b6cdcb2d4d6b4e8283047af8b33b02a5/users/c4988e798dbb43fda99d555d848ba866/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:50.325821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c53623-4457-4bea-8c67-45b552b122da None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:50.327103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c53623-4457-4bea-8c67-45b552b122da None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:50.327486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c53623-4457-4bea-8c67-45b552b122da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:50.414264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a8c53623-4457-4bea-8c67-45b552b122da None None] MFA Rules not processed for user `c4988e798dbb43fda99d555d848ba866`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:50.420266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a8c53623-4457-4bea-8c67-45b552b122da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:50.461104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:50.659904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 896/1777] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:50.661088 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:50.880939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecce08-7ee6-43b4-8d93-17ab8b508656 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:50.896638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:50.899414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:50.901248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:50.901248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:50.903655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:50.911129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:51.084813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 882/1778] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:50 2022] POST /identity/v3/projects => generated 405 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:51.089052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c53623-4457-4bea-8c67-45b552b122da None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:51.116584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c53623-4457-4bea-8c67-45b552b122da None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:51.337250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:51.337942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:51.338246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:51.338523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:51.339248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:51.341187 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:51.496636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 897/1779] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:51 2022] POST /identity/v3/users => generated 309 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:51.497791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:51.514679 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be52e21-e9fe-413f-9fff-5839aff2c611 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:51.554839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:51.554839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:51.554839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:51.554839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:51.555313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:51.555313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:51.570146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 883/1780] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:51.571723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:51.585628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb960f7-7c12-48f1-a89d-d4fb56b8cd40 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:51.597915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:51.599206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:51.599641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:51.599923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] PATH_INFO: `/v3/projects/3a52d4396509434c8b326038d40c97d4/users/8a3ec6f457424761a6946ec4b71089af/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:51.629863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a52d4396509434c8b326038d40c97d4, user_id=8a3ec6f457424761a6946ec4b71089af, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:51.634838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:52.039198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 898/1781] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:51 2022] PUT /identity/v3/projects/3a52d4396509434c8b326038d40c97d4/users/8a3ec6f457424761a6946ec4b71089af/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:44:52.042176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:52.052937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9588-fa55-4bde-8731-a87395577c87 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:52.149269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f78f11-7e9f-4cef-9e4f-5e8ff25074bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:52.149829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78f11-7e9f-4cef-9e4f-5e8ff25074bd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.150118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78f11-7e9f-4cef-9e4f-5e8ff25074bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.150424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78f11-7e9f-4cef-9e4f-5e8ff25074bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.151145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f78f11-7e9f-4cef-9e4f-5e8ff25074bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:52.152873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f78f11-7e9f-4cef-9e4f-5e8ff25074bd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:52.183998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 884/1782] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:52.186422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:52.214501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b688-41ff-48ee-8103-9099af55e490 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:52.224613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:52.226941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.227235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.230693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] PATH_INFO: `/v3/projects/3a52d4396509434c8b326038d40c97d4/users/8a3ec6f457424761a6946ec4b71089af/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.236713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a52d4396509434c8b326038d40c97d4, user_id=8a3ec6f457424761a6946ec4b71089af, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:52.239779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:52.263049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 899/1783] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:52 2022] PUT /identity/v3/projects/3a52d4396509434c8b326038d40c97d4/users/8a3ec6f457424761a6946ec4b71089af/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:52.265524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235da8d-e21f-4fa3-8687-e438baae99c3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.265877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235da8d-e21f-4fa3-8687-e438baae99c3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.266714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235da8d-e21f-4fa3-8687-e438baae99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.296450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:52.308404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e235da8d-e21f-4fa3-8687-e438baae99c3 None None] MFA Rules not processed for user `8a3ec6f457424761a6946ec4b71089af`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:52.309639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e235da8d-e21f-4fa3-8687-e438baae99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:52.408689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 885/1784] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:44:52.422506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:52.424786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:52.521072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73a978-bd95-4d96-8b54-93c36b12af2a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:52.543558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:52.543558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.543558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.543558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.559685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ab308-766d-413e-9cd9-3a26c0c2ca2e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.560140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:52.560604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ab308-766d-413e-9cd9-3a26c0c2ca2e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.561217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ab308-766d-413e-9cd9-3a26c0c2ca2e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.563702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:52.563893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 886/1785] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:44:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:44:52.598575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.598876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.599168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.600420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 900/1786] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:52.616002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:52.620755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:52.623069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:52.624494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:52.816639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 887/1787] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:52.839559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:52.841062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:52.854357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb195-d97b-4caf-9cf1-4d980daa0614 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:52.861316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:52.861515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bf85-d28a-4347-84c8-0f25b92a6ac0 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:52.863020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.865436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.865436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.868269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:52.869617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:52.869976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:52.870339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] PATH_INFO: `/v3/projects/4fe4a50ae8bc401f81e3fb501c02ac36` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:52.871890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe4a50ae8bc401f81e3fb501c02ac36)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:52.874381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:52.875309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:52.877585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:52.899727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 888/1788] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:53.056288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe4a50ae8bc401f81e3fb501c02ac36', 'request_id': 'req-be196752-1738-49a5-bd95-050510ffba6f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.061791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe4a50ae8bc401f81e3fb501c02ac36', 'request_id': 'req-be196752-1738-49a5-bd95-050510ffba6f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.179113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe4a50ae8bc401f81e3fb501c02ac36', 'request_id': 'req-be196752-1738-49a5-bd95-050510ffba6f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.187951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] The token cache is being invalidate because project 4fe4a50ae8bc401f81e3fb501c02ac36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:53.188574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.189895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-be196752-1738-49a5-bd95-050510ffba6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.191438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 901/1789] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:52 2022] DELETE /identity/v3/projects/4fe4a50ae8bc401f81e3fb501c02ac36 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:53.195450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:53.208302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82b1c6-fe48-457f-90fb-c2532b85046f service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:53.229738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024a308-748a-4869-af18-8d68c2043084 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.230098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024a308-748a-4869-af18-8d68c2043084 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.230399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024a308-748a-4869-af18-8d68c2043084 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:53.234005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 902/1790] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:44:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:53.243735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.245059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.245541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:53.287503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:53.290075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:53.327725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:53.327725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.327725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.328486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] PATH_INFO: `/v3/users/3849893f41cb42f39340a6caed3a4051` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:53.330922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3849893f41cb42f39340a6caed3a4051)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:53.333132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:53.395638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 903/1791] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:44:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:44:53.397104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:53.398979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:53.461697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab45348-808e-46f4-bd7f-4fecd27bded5 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:53.472947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:53.473614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.473958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.474270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:53.481186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:53.569072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3849893f41cb42f39340a6caed3a4051'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.570699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:53.575537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:53.583975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3849893f41cb42f39340a6caed3a4051'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.595689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 904/1792] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:53.600748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:53.607637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:53.622272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf3eb-885a-4dad-abee-8ede93e804a5 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:53.628453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209db1-d7a4-4f09-b61a-f72785192cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:53.629165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209db1-d7a4-4f09-b61a-f72785192cfb service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.629532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209db1-d7a4-4f09-b61a-f72785192cfb service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.629818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209db1-d7a4-4f09-b61a-f72785192cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:53.653129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c209db1-d7a4-4f09-b61a-f72785192cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:53.655012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c209db1-d7a4-4f09-b61a-f72785192cfb service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:53.669409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 905/1793] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:53.671786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6481559-2dcf-4a33-9638-4c104d00002e None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.672827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6481559-2dcf-4a33-9638-4c104d00002e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.673309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6481559-2dcf-4a33-9638-4c104d00002e None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:53.674890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 906/1794] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:53.684411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.684940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.685462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:53.698699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3849893f41cb42f39340a6caed3a4051'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.724558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3849893f41cb42f39340a6caed3a4051'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.725554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3849893f41cb42f39340a6caed3a4051'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:53.727886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] MFA Rules not processed for user `08c36dedeee54c2c84db268a76d4b37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:53.729485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:53.733601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 889/1795] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:53 2022] DELETE /identity/v3/users/3849893f41cb42f39340a6caed3a4051 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:53.835350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 907/1796] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:44:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:53.847249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:53.848736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:53.849276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:53.900565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:53.901995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:53.937471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a33be-795c-4418-a144-88b01c741d4b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:53.989358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c159-262b-413e-b203-6b3943cea5bc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:53.996501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:53.997170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:53.997453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:53.997729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:54.015954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:54.029762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:54.033195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:54.035356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:54.035955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:54.036470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] PATH_INFO: `/v3/users/d92edbbe67d549c0ab452abdb8cde1d7` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:54.038185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92edbbe67d549c0ab452abdb8cde1d7)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:54.041703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:54.058677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 890/1797] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:54.247086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92edbbe67d549c0ab452abdb8cde1d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:54.254622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92edbbe67d549c0ab452abdb8cde1d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:54.255410 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92edbbe67d549c0ab452abdb8cde1d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:54.255980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92edbbe67d549c0ab452abdb8cde1d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:54.346667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92edbbe67d549c0ab452abdb8cde1d7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:54.386037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 908/1798] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:53 2022] DELETE /identity/v3/users/d92edbbe67d549c0ab452abdb8cde1d7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:54.958137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:54.960921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:54.977816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8976e4-70c0-4f96-beac-2a9f180ca575 service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:55.055524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:55.056401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:55.056691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:55.056970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] PATH_INFO: `/v3/projects/650c174dfb22456dad71dec5f026bdc5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:55.058340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650c174dfb22456dad71dec5f026bdc5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:55.060542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:55.100277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:55.273871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650c174dfb22456dad71dec5f026bdc5', 'request_id': 'req-5ec04255-7464-4dee-9faf-5578a1e06567'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.293748 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650c174dfb22456dad71dec5f026bdc5', 'request_id': 'req-5ec04255-7464-4dee-9faf-5578a1e06567'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.397356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650c174dfb22456dad71dec5f026bdc5', 'request_id': 'req-5ec04255-7464-4dee-9faf-5578a1e06567'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.412537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] The token cache is being invalidate because project 650c174dfb22456dad71dec5f026bdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:55.414106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.414803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5ec04255-7464-4dee-9faf-5578a1e06567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.420878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:55.423661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:55.446140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 891/1799] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:54 2022] DELETE /identity/v3/projects/650c174dfb22456dad71dec5f026bdc5 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:55.449244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51cdc3-ba49-4be6-90b9-0a0bb0e9e195 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:55.449648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51cdc3-ba49-4be6-90b9-0a0bb0e9e195 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:55.450262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51cdc3-ba49-4be6-90b9-0a0bb0e9e195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:55.456212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc00e0-b5fc-43b2-8709-5630224b1ab1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:55.492918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-eb51cdc3-ba49-4be6-90b9-0a0bb0e9e195 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:55.492918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-eb51cdc3-ba49-4be6-90b9-0a0bb0e9e195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:55.566935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:55.639838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:55.641511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:55.648583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:55.649518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] PATH_INFO: `/v3/projects/fd48428b48a74d93a48edd754bc786b3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:55.652435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd48428b48a74d93a48edd754bc786b3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:55.653817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 892/1800] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:55.659270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:55.666009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eed0f-0098-45ad-891e-88692d07f459 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:55.666329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eed0f-0098-45ad-891e-88692d07f459 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:55.671003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eed0f-0098-45ad-891e-88692d07f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:55.716717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7a7eed0f-0098-45ad-891e-88692d07f459 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:55.718005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7a7eed0f-0098-45ad-891e-88692d07f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:55.735115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 893/1801] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:55.741158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eed0f-0098-45ad-891e-88692d07f459 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:55.769894 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eed0f-0098-45ad-891e-88692d07f459 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:55.778240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:55.778753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:55.779042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:55.779321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:55.780593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:55.781048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:55.787404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:55.815961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 894/1802] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:55.821283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:55.830983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:55.865857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd48428b48a74d93a48edd754bc786b3', 'request_id': 'req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.882490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd48428b48a74d93a48edd754bc786b3', 'request_id': 'req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.900932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:55.959814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd48428b48a74d93a48edd754bc786b3', 'request_id': 'req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:55.960810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab60f-4b44-4833-a835-cda69721e7cd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:55.999631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] The token cache is being invalidate because project fd48428b48a74d93a48edd754bc786b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:56.005231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:56.007873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:56.010598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 909/1803] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:55 2022] DELETE /identity/v3/projects/fd48428b48a74d93a48edd754bc786b3 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:56.017497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:56.028039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:56.042583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:56.043322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:56.044277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:56.044625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:56.063652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:56.145909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37d9ab-35ed-49f7-8a5e-5fafc6022c78 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:56.153207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:56.153928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:56.154643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:56.155014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:56.156079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:56.159454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:56.187650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:56.189736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:56.200513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 895/1804] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:56.201783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:56.203207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:56.221081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc88c8-7458-4f10-8ebc-d4b02722a907 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:56.226566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:56.227548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:56.228045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:56.228375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] PATH_INFO: `/v3/users/902514d2379c40fe829ecd516f55e9ba` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:56.229805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=902514d2379c40fe829ecd516f55e9ba)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:56.231941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:56.317623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 910/1805] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:56 2022] POST /identity/v3/projects => generated 391 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:56.323778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:56.467210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbba20-16c6-44f5-b72b-ad5fd752f598 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:56.479205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:56.480852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:56.481270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:56.481714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:56.482615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:56.484737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:56.553075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902514d2379c40fe829ecd516f55e9ba'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:56.566237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902514d2379c40fe829ecd516f55e9ba'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:56.585038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 911/1806] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:56 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:56.586514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:56.599792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fe89b-d84d-412f-ab7f-cfb59b5232bd admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:56.605577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:56.606952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:56.607414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:56.608007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:56.608955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:56.610952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:56.625921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 912/1807] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:56.632037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:56.652478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f442-c154-47c7-8a98-88d128d3b397 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:56.661229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9ab8f-63c6-49d3-b8aa-69246e6eeb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:56.662423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9ab8f-63c6-49d3-b8aa-69246e6eeb33 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:56.663541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9ab8f-63c6-49d3-b8aa-69246e6eeb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:56.663976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9ab8f-63c6-49d3-b8aa-69246e6eeb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:56.674602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902514d2379c40fe829ecd516f55e9ba'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:56.682274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9ab8f-63c6-49d3-b8aa-69246e6eeb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:56.685985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9ab8f-63c6-49d3-b8aa-69246e6eeb33 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:56.696537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902514d2379c40fe829ecd516f55e9ba'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:56.702072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902514d2379c40fe829ecd516f55e9ba'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:56.725896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 896/1808] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:44:56 2022] DELETE /identity/v3/users/902514d2379c40fe829ecd516f55e9ba => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:56.738392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 913/1809] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:44:56.741606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:56.747511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:56.898505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d094d6-175b-46cb-9ef0-06a650ac1eef admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:56.913355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:56.914697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:56.917945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:56.918778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] PATH_INFO: `/v3/projects/de966552e7c34d958a1a19a7a249e4e1/users/fbf474d0eb1b441985a12d4087b77a40/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:56.944796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=de966552e7c34d958a1a19a7a249e4e1, user_id=fbf474d0eb1b441985a12d4087b77a40, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:56.948642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:57.733249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 897/1810] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:56 2022] PUT /identity/v3/projects/de966552e7c34d958a1a19a7a249e4e1/users/fbf474d0eb1b441985a12d4087b77a40/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:57.762342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:57.763289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:57.763766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:57.796542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] MFA Rules not processed for user `fbf474d0eb1b441985a12d4087b77a40`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:57.798402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:57.869363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 914/1811] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:57.870885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:57.943328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26bf5-7ffe-4ca5-9bd4-b922cc7f6dad admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:57.954318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:57.955000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:57.955378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:57.955666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:57.956434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:57.959004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:57.978676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:57.980566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:58.009249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ebe62-bb63-40e6-beae-f4bccd8000fe None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:58.041014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:58.041980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.042360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.043311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] PATH_INFO: `/v3/projects/9b645f96779b4d19ab5b45d5aed137ba` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.056121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b645f96779b4d19ab5b45d5aed137ba)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:58.058289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:58.093852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:58.128674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 898/1812] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:57 2022] POST /identity/v3/projects => generated 393 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:58.134416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:58.270182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b645f96779b4d19ab5b45d5aed137ba', 'request_id': 'req-4b6f892f-0ded-4a09-be63-fab7ef202519'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:58.283012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b645f96779b4d19ab5b45d5aed137ba', 'request_id': 'req-4b6f892f-0ded-4a09-be63-fab7ef202519'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:58.297041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795232-c482-439b-aacb-43778eac6847 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:58.363358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b645f96779b4d19ab5b45d5aed137ba', 'request_id': 'req-4b6f892f-0ded-4a09-be63-fab7ef202519'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:58.389019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] The token cache is being invalidate because project 9b645f96779b4d19ab5b45d5aed137ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:44:58.390889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:58.394058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4b6f892f-0ded-4a09-be63-fab7ef202519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:44:58.401686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 915/1813] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:44:57 2022] DELETE /identity/v3/projects/9b645f96779b4d19ab5b45d5aed137ba => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:58.401686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505206dc-0f8c-43d4-9d0a-4ce41ebe72b6 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.401686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505206dc-0f8c-43d4-9d0a-4ce41ebe72b6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.401686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505206dc-0f8c-43d4-9d0a-4ce41ebe72b6 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.404023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 916/1814] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:44:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:44:58.405411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc9bc-da17-454e-b819-8e3c44a5a0b0 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.405809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc9bc-da17-454e-b819-8e3c44a5a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.406369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc9bc-da17-454e-b819-8e3c44a5a0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.429441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d6a1d-261e-4468-b964-da28384b7b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:58.430176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6a1d-261e-4468-b964-da28384b7b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.430493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6a1d-261e-4468-b964-da28384b7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.431040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6a1d-261e-4468-b964-da28384b7b1f admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.431677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-949bc9bc-da17-454e-b819-8e3c44a5a0b0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:58.431987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d6a1d-261e-4468-b964-da28384b7b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:58.433026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-949bc9bc-da17-454e-b819-8e3c44a5a0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:58.434268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d6a1d-261e-4468-b964-da28384b7b1f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:58.449651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 917/1815] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:58.457230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.457230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.457230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.479989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:58.492046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:58.620585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 899/1816] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:58 2022] POST /identity/v3/users => generated 303 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:58.622639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.623116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.623759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.648614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 918/1817] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:58.650179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:58.651951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:58.667886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:58.669501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:58.675209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521e41-a9ce-4039-b648-e7d59584b824 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:58.683238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:58.684057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.684348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.684627 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.685385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:58.690026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:58.692913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 900/1818] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:58.694226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:58.700662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:58.713190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 919/1819] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:58.713190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:58.730247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4968054-46df-46f7-8043-553d03331a0a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:58.741292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a925b5-3e64-4223-9d70-eadad1250c62 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:58.746948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:58.747722 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.748009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.748287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.748847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:58.749014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:44:58.749580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:58.749786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.750266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.751173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.751984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:58.775842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 920/1820] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:44:58.776814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:58.777818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:58.778863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:58.795664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50954131-b526-4e2a-ab5e-fb7d03f2a7dc admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:58.802900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 901/1821] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:44:58.803357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:58.804059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:58.804945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.805229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.805512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] PATH_INFO: `/v3/projects/3e6d1091d538438f950fabce45dd7b75/users/746b7d4aca1b42f28ff0265dbb0dd500/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.830028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e16df2-66b1-4a8a-9edc-df2e9b338b68 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:58.830243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6d1091d538438f950fabce45dd7b75, user_id=746b7d4aca1b42f28ff0265dbb0dd500, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:58.833534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:58.840336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:58.842642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:58.844594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:58.844594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:58.844594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:58.847001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:58.929335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 921/1822] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:58 2022] PUT /identity/v3/projects/3e6d1091d538438f950fabce45dd7b75/users/746b7d4aca1b42f28ff0265dbb0dd500/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:58.933924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:58.993134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 902/1823] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:44:58 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:58.997364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:59.118913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813e35-d43e-4bb2-9ebf-36799e8f3146 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.131935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b37a-a31b-4737-b812-6f77ee045256 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.135557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.136287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.136678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.137298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.138140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:59.139208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.140161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.140453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.140760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.141470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:59.143501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:59.144000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:59.202525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 922/1824] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:59.202525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:59.225585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f7685-ca58-4080-a658-41bf9ccfd39c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.244537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bd851-a120-4de3-81a7-22bbf62081bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.245611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd851-a120-4de3-81a7-22bbf62081bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.246925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd851-a120-4de3-81a7-22bbf62081bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.247897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd851-a120-4de3-81a7-22bbf62081bf admin admin] PATH_INFO: `/v3/projects/3e6d1091d538438f950fabce45dd7b75/users/746b7d4aca1b42f28ff0265dbb0dd500/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.252968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bd851-a120-4de3-81a7-22bbf62081bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6d1091d538438f950fabce45dd7b75, user_id=746b7d4aca1b42f28ff0265dbb0dd500, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:59.255909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bd851-a120-4de3-81a7-22bbf62081bf admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:59.272967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 903/1825] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:44:58 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:44:59.276240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:59.300136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 923/1826] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:59 2022] PUT /identity/v3/projects/3e6d1091d538438f950fabce45dd7b75/users/746b7d4aca1b42f28ff0265dbb0dd500/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:59.303341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.303639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.303929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.326939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b5ba-242a-4716-b3c0-8a17523b6a4e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.377807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] MFA Rules not processed for user `746b7d4aca1b42f28ff0265dbb0dd500`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:59.379350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:59.475556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.476249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.476539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.476817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.477548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:59.479235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:59.493980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 904/1827] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:44:59.495382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:59.509567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500809-c651-4295-a08a-20f522a1d182 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.528214 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.534780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.535148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.535533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.537829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:59.539600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:59.545534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 924/1828] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:44:59.554307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:59.556200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:59.574068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 905/1829] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:44:59.577138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:59.591735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a918cd1-ac87-467a-9b1b-1d8448da8ed7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.608467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:59.614013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.614013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.614013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.615043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] PATH_INFO: `/v3/projects/d08fabdd505944ce9bfbc159de2ea603/users/87ec2b6d4b8543fcbabc99101609ced7/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.644386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08fabdd505944ce9bfbc159de2ea603, user_id=87ec2b6d4b8543fcbabc99101609ced7, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:59.665197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:59.686437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032f829-5ce7-4188-aabd-25587afb67c5 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.704010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c013ca-f65d-4e6e-9668-def2a0a5c71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.704799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c013ca-f65d-4e6e-9668-def2a0a5c71f service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.705141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c013ca-f65d-4e6e-9668-def2a0a5c71f service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.705469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c013ca-f65d-4e6e-9668-def2a0a5c71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.719713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c013ca-f65d-4e6e-9668-def2a0a5c71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:44:59.723494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c013ca-f65d-4e6e-9668-def2a0a5c71f service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:44:59.740830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 925/1830] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:44:59.800164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 906/1831] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:44:59 2022] PUT /identity/v3/projects/d08fabdd505944ce9bfbc159de2ea603/users/87ec2b6d4b8543fcbabc99101609ced7/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:44:59.819582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3dcee-f44e-4807-a39e-fb10df3224f4 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.820058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3dcee-f44e-4807-a39e-fb10df3224f4 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.820246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3dcee-f44e-4807-a39e-fb10df3224f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.841347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:44:59.892709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6ab3dcee-f44e-4807-a39e-fb10df3224f4 None None] MFA Rules not processed for user `87ec2b6d4b8543fcbabc99101609ced7`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:44:59.896369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6ab3dcee-f44e-4807-a39e-fb10df3224f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:44:59.966791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c5c8d-a282-4055-ac56-6f67a8078d54 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:44:59.988902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:44:59.989896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:44:59.991071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:44:59.994578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:44:59.998168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:00.076669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 926/1832] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:00.080756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3dcee-f44e-4807-a39e-fb10df3224f4 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:00.094514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:00.096103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:00.110735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 907/1833] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:44:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:00.309436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3dcee-f44e-4807-a39e-fb10df3224f4 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:00.333268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:00.333983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:00.334290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:00.334572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:00.341093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:00.351341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:00.596239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 927/1834] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:00 2022] POST /identity/v3/projects => generated 385 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:00.600297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:00.613138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50e5a-1896-4285-87fa-c9824cd0b383 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:00.726757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:00.727236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:00.727687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:00.728462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:00.729806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:00.735288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:00.866746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 908/1835] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:00 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:00.870465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:00.881221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d235-91b7-4cdb-8bc3-52d1475a04e7 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:00.885932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:00.886761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:00.886945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:00.887702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:00.888431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:00.890025 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:00.901615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 928/1836] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:00.905855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:00.918424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a0282-b829-467c-b6c2-5fd1a2ebe4eb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:00.923764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:00.924720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:00.925421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:00.925421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] PATH_INFO: `/v3/projects/f5b5d94fbc7e4d51bd2e2b17b8b6a128/users/97286ea31cb04637a76bf89843fbf3b7/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:00.941460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b5d94fbc7e4d51bd2e2b17b8b6a128, user_id=97286ea31cb04637a76bf89843fbf3b7, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:00.944140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:01.082075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 909/1837] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:00 2022] PUT /identity/v3/projects/f5b5d94fbc7e4d51bd2e2b17b8b6a128/users/97286ea31cb04637a76bf89843fbf3b7/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:01.083735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:01.110774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c193c-4075-4bdd-8391-0aefcc8ed3c1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:01.229735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7b1e-b266-4b46-9983-aba5af4e7d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:01.229850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b1e-b266-4b46-9983-aba5af4e7d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:01.230774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b1e-b266-4b46-9983-aba5af4e7d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:01.231163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b1e-b266-4b46-9983-aba5af4e7d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:01.231989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7b1e-b266-4b46-9983-aba5af4e7d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:01.233884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7b1e-b266-4b46-9983-aba5af4e7d4a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:01.251018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:01.251542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 929/1838] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:01.264973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de3d03-aead-4606-84ca-a8ce6991b4b9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:01.272357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:01.273361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:01.273650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:01.273957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] PATH_INFO: `/v3/projects/f5b5d94fbc7e4d51bd2e2b17b8b6a128/users/97286ea31cb04637a76bf89843fbf3b7/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:01.276362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b5d94fbc7e4d51bd2e2b17b8b6a128, user_id=97286ea31cb04637a76bf89843fbf3b7, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:01.279536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:01.304194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 910/1839] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:01 2022] PUT /identity/v3/projects/f5b5d94fbc7e4d51bd2e2b17b8b6a128/users/97286ea31cb04637a76bf89843fbf3b7/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:01.315937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3ded-d9a0-4588-ba6e-bfa70acb001b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:01.316225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3ded-d9a0-4588-ba6e-bfa70acb001b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:01.316508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3ded-d9a0-4588-ba6e-bfa70acb001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:01.325888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:01.345280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-17af3ded-d9a0-4588-ba6e-bfa70acb001b None None] MFA Rules not processed for user `97286ea31cb04637a76bf89843fbf3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:01.346584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-17af3ded-d9a0-4588-ba6e-bfa70acb001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:01.414862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 930/1840] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:01.426353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:01.488887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8f63-4f31-473f-950b-56ecb4575412 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:01.492669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167ad6d-e3da-47d0-9ce0-fc451c9f617f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:01.493326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167ad6d-e3da-47d0-9ce0-fc451c9f617f service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:01.493615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167ad6d-e3da-47d0-9ce0-fc451c9f617f service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:01.493898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167ad6d-e3da-47d0-9ce0-fc451c9f617f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:01.513612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167ad6d-e3da-47d0-9ce0-fc451c9f617f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:01.515177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167ad6d-e3da-47d0-9ce0-fc451c9f617f service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:01.526273 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 911/1841] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:01.553011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af3ded-d9a0-4588-ba6e-bfa70acb001b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:01.615656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af3ded-d9a0-4588-ba6e-bfa70acb001b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:01.625870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:01.628735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:01.629054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:01.629339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] PATH_INFO: `/v3/users/87ec2b6d4b8543fcbabc99101609ced7` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:01.631043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ec2b6d4b8543fcbabc99101609ced7)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:01.633353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:01.977185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ec2b6d4b8543fcbabc99101609ced7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:01.985277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ec2b6d4b8543fcbabc99101609ced7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:01.986056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ec2b6d4b8543fcbabc99101609ced7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:01.986986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ec2b6d4b8543fcbabc99101609ced7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:02.065361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ec2b6d4b8543fcbabc99101609ced7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:02.085684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 931/1842] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:01 2022] DELETE /identity/v3/users/87ec2b6d4b8543fcbabc99101609ced7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:02.090277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:02.092972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:02.093306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:02.124460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:02.126590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:02.183667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 912/1843] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:02.193494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:02.199777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:02.264009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316e790-e92e-4f3f-a37e-1966da5bbfd1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:02.267748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:02.268407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:02.268691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:02.268967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:02.278955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:02.280409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:02.294110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 932/1844] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:02.500005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:02.502000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:02.515497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495c0ae-c7b5-44c2-884d-5e816e4d2b73 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:02.533218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:02.534521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:02.534866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:02.540409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] PATH_INFO: `/v3/users/c4988e798dbb43fda99d555d848ba866` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:02.540409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4988e798dbb43fda99d555d848ba866)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:02.540409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:02.854298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4988e798dbb43fda99d555d848ba866'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:02.862591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4988e798dbb43fda99d555d848ba866'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:02.930260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:02.931773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:02.948045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4988e798dbb43fda99d555d848ba866'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:02.956380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26e80e-8528-4b5b-8855-99791496e84a service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:02.965676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:02.966783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:02.967245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:02.967672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] PATH_INFO: `/v3/projects/d08fabdd505944ce9bfbc159de2ea603` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:02.969575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4988e798dbb43fda99d555d848ba866'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:02.970323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08fabdd505944ce9bfbc159de2ea603)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:02.971504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb388ae3-de96-4b19-985d-15f4c990ad93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4988e798dbb43fda99d555d848ba866'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:02.977485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:02.995276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 913/1845] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:02 2022] DELETE /identity/v3/users/c4988e798dbb43fda99d555d848ba866 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:02.997826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:02.997948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:02.998189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:03.031908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:03.033314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:03.127666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 914/1846] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:03.135197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:03.137235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:03.180116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08fabdd505944ce9bfbc159de2ea603', 'request_id': 'req-36a9da76-a3b1-4432-99e4-fd1377fc36bc'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.196806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08fabdd505944ce9bfbc159de2ea603', 'request_id': 'req-36a9da76-a3b1-4432-99e4-fd1377fc36bc'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.216697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f283cbb-26a2-44d5-bfa3-13c74b964428 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:03.273483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:03.274057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:03.275064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:03.275064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:03.322191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:03.352633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:03.354173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:03.365648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 915/1847] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:03.405349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08fabdd505944ce9bfbc159de2ea603', 'request_id': 'req-36a9da76-a3b1-4432-99e4-fd1377fc36bc'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.426899 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] The token cache is being invalidate because project d08fabdd505944ce9bfbc159de2ea603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:03.427454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.428225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.436065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:03.439959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 933/1848] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:02 2022] DELETE /identity/v3/projects/d08fabdd505944ce9bfbc159de2ea603 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:03.440285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:03.456972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ab8c9-de0d-423e-b728-2768b89308c7 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:03.464426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:03.465478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:03.465860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:03.466195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] PATH_INFO: `/v3/users/97286ea31cb04637a76bf89843fbf3b7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:03.467664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97286ea31cb04637a76bf89843fbf3b7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:03.470856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:03.782071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97286ea31cb04637a76bf89843fbf3b7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.797206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97286ea31cb04637a76bf89843fbf3b7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.903430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97286ea31cb04637a76bf89843fbf3b7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.917547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97286ea31cb04637a76bf89843fbf3b7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.918322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97286ea31cb04637a76bf89843fbf3b7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:03.924761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 916/1849] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:03 2022] DELETE /identity/v3/users/97286ea31cb04637a76bf89843fbf3b7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:03.943742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:04.190417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:04.192210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:04.212702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9da76-a3b1-4432-99e4-fd1377fc36bc admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:04.291761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:04.293235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:04.293691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:04.294149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] PATH_INFO: `/v3/users/47f084b231a34294a4b8140228abb269` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:04.304271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f084b231a34294a4b8140228abb269)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:04.306426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:04.321662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:04.323672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:04.337362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd881-509e-4bf4-aa99-49e39553c307 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:04.346899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:04.348100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:04.348461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:04.348948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] PATH_INFO: `/v3/projects/b6cdcb2d4d6b4e8283047af8b33b02a5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:04.350301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cdcb2d4d6b4e8283047af8b33b02a5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:04.352400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:04.558040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f084b231a34294a4b8140228abb269'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.561787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cdcb2d4d6b4e8283047af8b33b02a5', 'request_id': 'req-24b27523-dd7d-4e71-b079-6f14d74bea80'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.586071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f084b231a34294a4b8140228abb269'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.590061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f084b231a34294a4b8140228abb269'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.592579 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f084b231a34294a4b8140228abb269'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.594356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cdcb2d4d6b4e8283047af8b33b02a5', 'request_id': 'req-24b27523-dd7d-4e71-b079-6f14d74bea80'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.716083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cdcb2d4d6b4e8283047af8b33b02a5', 'request_id': 'req-24b27523-dd7d-4e71-b079-6f14d74bea80'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.734825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] The token cache is being invalidate because project b6cdcb2d4d6b4e8283047af8b33b02a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:04.735184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.736269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.741297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 917/1850] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:04 2022] DELETE /identity/v3/projects/b6cdcb2d4d6b4e8283047af8b33b02a5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:04.747422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:04.749306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:04.800570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f084b231a34294a4b8140228abb269'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:04.819080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 934/1851] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:04 2022] DELETE /identity/v3/users/47f084b231a34294a4b8140228abb269 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:04.822995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:04.824340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:04.838967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27523-dd7d-4e71-b079-6f14d74bea80 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:04.901159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:04.902842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:04.902842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:04.902842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] PATH_INFO: `/v3/users/8a3ec6f457424761a6946ec4b71089af` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:04.904387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3ec6f457424761a6946ec4b71089af)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:04.906884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:04.916133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6c286-fda6-4a36-b2fb-bc9f967c6759 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:04.921565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:04.922506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:04.922793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:04.923066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] PATH_INFO: `/v3/projects/f5b5d94fbc7e4d51bd2e2b17b8b6a128` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:04.924376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b5d94fbc7e4d51bd2e2b17b8b6a128)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:04.926418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:05.113815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b5d94fbc7e4d51bd2e2b17b8b6a128', 'request_id': 'req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.119903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3ec6f457424761a6946ec4b71089af'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.120325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b5d94fbc7e4d51bd2e2b17b8b6a128', 'request_id': 'req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.132004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3ec6f457424761a6946ec4b71089af'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.254001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b5d94fbc7e4d51bd2e2b17b8b6a128', 'request_id': 'req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.269717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] The token cache is being invalidate because project f5b5d94fbc7e4d51bd2e2b17b8b6a128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:05.270326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.270995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-97c5e615-ae09-4f46-beb9-bd87c5f1ca16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.272619 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 935/1852] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:04 2022] DELETE /identity/v3/projects/f5b5d94fbc7e4d51bd2e2b17b8b6a128 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:05.274059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171dd9c-d88e-416e-a4e2-25c5f88b5472 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:05.274552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171dd9c-d88e-416e-a4e2-25c5f88b5472 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:05.275570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171dd9c-d88e-416e-a4e2-25c5f88b5472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:05.299209 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4171dd9c-d88e-416e-a4e2-25c5f88b5472 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:05.300422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4171dd9c-d88e-416e-a4e2-25c5f88b5472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:05.371848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 936/1853] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:05.377794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:05.378181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:05.378609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:05.401727 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:05.403141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:05.412132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 937/1854] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:05.421470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:05.421470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:05.456443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3ec6f457424761a6946ec4b71089af'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.479866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3ec6f457424761a6946ec4b71089af'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.481006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e41d5e5-7463-4436-84eb-b862c30e7384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3ec6f457424761a6946ec4b71089af'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:05.495014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 918/1855] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:04 2022] DELETE /identity/v3/users/8a3ec6f457424761a6946ec4b71089af => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:05.498674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f272e-bda7-48f4-a432-0d6e873bc865 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:05.499135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f272e-bda7-48f4-a432-0d6e873bc865 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:05.500246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f272e-bda7-48f4-a432-0d6e873bc865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:05.519627 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0838b6-e177-429f-b9a4-97ad7288731c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:05.538888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-705f272e-bda7-48f4-a432-0d6e873bc865 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:05.540791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-705f272e-bda7-48f4-a432-0d6e873bc865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:05.588435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:05.591425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:05.591921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:05.592528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:05.596186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:05.640070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 919/1856] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:05.641016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f272e-bda7-48f4-a432-0d6e873bc865 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:05.664605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f272e-bda7-48f4-a432-0d6e873bc865 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:05.669931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:05.675052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:05.675052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:05.675052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:05.675052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:05.675052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:05.675052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:05.681921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:05.683515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:05.689443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 920/1857] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:05.693276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:05.695231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 938/1858] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:05.703833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720d527-4d1b-4c16-b05d-19a880ae15e3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:05.708789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:05.709458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:05.710157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:05.710157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:05.715640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:05.715640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:05.807840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 921/1859] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:05 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:05.808556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:05.819555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46353af-81e6-4a68-9d2d-9ee657422de3 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:05.888587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:05.889266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:05.889580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:05.889864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:05.890592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:05.892537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.001496 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 939/1860] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:05 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:06.005300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.016946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc4a29-3d05-4471-817c-9bc6bffd7f8a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.023520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.024269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.024626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.024915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.025648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.027315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.038614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.042704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 922/1861] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:06.043800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.043919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.055043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8333a-dec0-4893-a112-f570f049fdb2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.058828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093112-6893-44a3-b37e-d5ccd8e97a71 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.060961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.061959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.062576 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.063039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.064028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.065130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.065932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.066406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.069064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.069064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] PATH_INFO: `/v3/projects/3a52d4396509434c8b326038d40c97d4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.069064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a52d4396509434c8b326038d40c97d4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.070880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.080029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 923/1862] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:06.084775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.100084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30a24b-5ab9-4856-b7ae-30f33c29eca1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.105063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cd6d9-8e44-4c20-8446-9f4a319942c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.106039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd6d9-8e44-4c20-8446-9f4a319942c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.106435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd6d9-8e44-4c20-8446-9f4a319942c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.106790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd6d9-8e44-4c20-8446-9f4a319942c5 admin admin] PATH_INFO: `/v3/projects/e90933cd7f334a0e8feebf3b2a933486/users/a3a7b2b985a14b2d800e619b975f924a/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.124284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cd6d9-8e44-4c20-8446-9f4a319942c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90933cd7f334a0e8feebf3b2a933486, user_id=a3a7b2b985a14b2d800e619b975f924a, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.127192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cd6d9-8e44-4c20-8446-9f4a319942c5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.222309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 924/1863] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:06 2022] PUT /identity/v3/projects/e90933cd7f334a0e8feebf3b2a933486/users/a3a7b2b985a14b2d800e619b975f924a/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:06.236858 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589675eb-e7bf-40b1-bd7e-f0d8267eb16e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.237418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589675eb-e7bf-40b1-bd7e-f0d8267eb16e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.238097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589675eb-e7bf-40b1-bd7e-f0d8267eb16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.259264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a52d4396509434c8b326038d40c97d4', 'request_id': 'req-b2136848-0fdd-4b55-80f7-a270de9773f1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.267787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a52d4396509434c8b326038d40c97d4', 'request_id': 'req-b2136848-0fdd-4b55-80f7-a270de9773f1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.293114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-589675eb-e7bf-40b1-bd7e-f0d8267eb16e None None] MFA Rules not processed for user `a3a7b2b985a14b2d800e619b975f924a`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:06.293114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-589675eb-e7bf-40b1-bd7e-f0d8267eb16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.346376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a52d4396509434c8b326038d40c97d4', 'request_id': 'req-b2136848-0fdd-4b55-80f7-a270de9773f1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.360871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] The token cache is being invalidate because project 3a52d4396509434c8b326038d40c97d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:06.361507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.362589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.364401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 940/1864] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:06 2022] DELETE /identity/v3/projects/3a52d4396509434c8b326038d40c97d4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:06.365608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.367180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.376045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 925/1865] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:06.377567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.377872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.378291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.397455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:06.398743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.444380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2136848-0fdd-4b55-80f7-a270de9773f1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.450174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.451126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.451406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.451675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] PATH_INFO: `/v3/users/fbf474d0eb1b441985a12d4087b77a40` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.454045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf474d0eb1b441985a12d4087b77a40)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.456646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.466597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 926/1866] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:06.467536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.468835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.481517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b8741-9395-4c3c-b0df-0bfbf08b57a4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.486375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d698d-98f7-4949-8de0-d7339b5e9090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.487046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d698d-98f7-4949-8de0-d7339b5e9090 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.487331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d698d-98f7-4949-8de0-d7339b5e9090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.487773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d698d-98f7-4949-8de0-d7339b5e9090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.488622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d698d-98f7-4949-8de0-d7339b5e9090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.491235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d698d-98f7-4949-8de0-d7339b5e9090 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.592703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 927/1867] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:06 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:06.595119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.595409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.595775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.618380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:06.620221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.621453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf474d0eb1b441985a12d4087b77a40'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.630846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf474d0eb1b441985a12d4087b77a40'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.632158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf474d0eb1b441985a12d4087b77a40'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.633075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf474d0eb1b441985a12d4087b77a40'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.685228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 928/1868] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:06.688511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.690060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.705095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf474d0eb1b441985a12d4087b77a40'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.718521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68482d1-1962-4970-9feb-f3abebc03a39 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.723940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.724756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.725035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.728029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] PATH_INFO: `/v3/projects/0391449b2668449daf1011b069cdb584` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.728029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0391449b2668449daf1011b069cdb584)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.728657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.729576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 941/1869] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:06 2022] DELETE /identity/v3/users/fbf474d0eb1b441985a12d4087b77a40 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:06.731006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.732956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:06.810754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ded54-7b05-4fa7-a1a1-e3970e5a89f6 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.816920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:06.817081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.817277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.817584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:06.818368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:06.821012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:06.854119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0391449b2668449daf1011b069cdb584', 'request_id': 'req-5e43f29f-236c-411e-bf38-322fe62823f0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.859956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0391449b2668449daf1011b069cdb584', 'request_id': 'req-5e43f29f-236c-411e-bf38-322fe62823f0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.926925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 942/1870] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:06 2022] POST /identity/v3/users => generated 307 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:06.928189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:06.939188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2f56-e60c-490a-9575-1a6e870efd88 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:06.945022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0391449b2668449daf1011b069cdb584', 'request_id': 'req-5e43f29f-236c-411e-bf38-322fe62823f0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.965447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] The token cache is being invalidate because project 0391449b2668449daf1011b069cdb584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:06.965983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.967001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e43f29f-236c-411e-bf38-322fe62823f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:06.970721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 929/1871] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:06 2022] DELETE /identity/v3/projects/0391449b2668449daf1011b069cdb584 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:06.972767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:06.973405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:06.973853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.001996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:07.003302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.019301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.021909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.023220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.023592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.025735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:07.025995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.027676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.042696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 943/1872] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:07.042696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.043820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.058512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509d926-b39e-4875-909c-8e3ed5e9d0ad admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.066953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.067717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.068080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.068431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.069239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.071119 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.087478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 944/1873] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:07.088453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.090179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 930/1874] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:07.090618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.091166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.092668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.106702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db20b4-179c-4844-b8f1-036ce2e1eb9a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.108778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5606ac-1f33-4e36-98b5-efb9b9d40f03 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.113747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.114486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.114771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.114878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.115071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.115692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.115811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.116130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.116420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] PATH_INFO: `/v3/users/1d9342eb1889418eb661aa434f880fb4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.117625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9342eb1889418eb661aa434f880fb4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.117993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.119618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.215082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 931/1875] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:07 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:07.216301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.220082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.277799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef880b-0741-4438-9a7a-e2a4f7d49376 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.282483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.284102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.284102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.284102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.321090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9342eb1889418eb661aa434f880fb4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:07.329514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9342eb1889418eb661aa434f880fb4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:07.329514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9342eb1889418eb661aa434f880fb4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:07.330377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9342eb1889418eb661aa434f880fb4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:07.364460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.365948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.375730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 932/1876] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:07.377939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.387531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf9c6-9178-43cb-a4a2-ec714f176f25 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.392381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.393420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.393708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.393991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] PATH_INFO: `/v3/projects/6c9ce1ec5d2d40089a376183e6ae5233/users/9b2b49ebbd23488f8d8ac8ba49890869/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.410737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ce1ec5d2d40089a376183e6ae5233, user_id=9b2b49ebbd23488f8d8ac8ba49890869, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.412316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9342eb1889418eb661aa434f880fb4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:07.415865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.431799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 945/1877] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:07 2022] DELETE /identity/v3/users/1d9342eb1889418eb661aa434f880fb4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:07.434371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.434371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.502052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0662-6b91-453f-b638-9a08f2c1db11 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.506697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.507373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.507850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.507985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.508620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.510644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.528878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 933/1878] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:07 2022] PUT /identity/v3/projects/6c9ce1ec5d2d40089a376183e6ae5233/users/9b2b49ebbd23488f8d8ac8ba49890869/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:07.533412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.535606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.616435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c147-7550-4e5f-ae40-747944c4c22d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.622544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.623884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.623884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.623884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.624436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.626374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.637064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 946/1879] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:07 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:07.639028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 934/1880] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:07.641829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.643673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.654759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a84f3a-5d8a-4cb3-8442-2ef0d88c35ae admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.661356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.662422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.662893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.663323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.663913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddf2c-c84d-4d3e-ab15-0b214a8ab0ae admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.664410 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.673667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.674733 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bce5d-d397-4785-9648-bc8784cff4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.675788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bce5d-d397-4785-9648-bc8784cff4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.676105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bce5d-d397-4785-9648-bc8784cff4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.676389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bce5d-d397-4785-9648-bc8784cff4eb admin admin] PATH_INFO: `/v3/projects/6c9ce1ec5d2d40089a376183e6ae5233/users/9b2b49ebbd23488f8d8ac8ba49890869/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.678487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bce5d-d397-4785-9648-bc8784cff4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ce1ec5d2d40089a376183e6ae5233, user_id=9b2b49ebbd23488f8d8ac8ba49890869, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.681322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bce5d-d397-4785-9648-bc8784cff4eb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.690285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 947/1881] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:07.693511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.694320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 935/1882] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:07 2022] PUT /identity/v3/projects/6c9ce1ec5d2d40089a376183e6ae5233/users/9b2b49ebbd23488f8d8ac8ba49890869/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:07.709639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7708b-0ec6-4bcd-bc60-29b03d7b226c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.718567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.721556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.723934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.764668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] MFA Rules not processed for user `9b2b49ebbd23488f8d8ac8ba49890869`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:07.765586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.789465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:07.823196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.823887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.829846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.829846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.829846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.829846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.843459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 948/1883] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:07.847662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.858325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39c29-605b-472f-94be-31ca38995402 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:07.865522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:07.865522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:07.865522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:07.865522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] PATH_INFO: `/v3/projects/4e4e985135264724919d8e9b049f4c98/users/6327b26ee77e4185b4f7ec8b3e496ee4/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:07.887974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4e985135264724919d8e9b049f4c98, user_id=6327b26ee77e4185b4f7ec8b3e496ee4, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:07.888237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 936/1884] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:07.888328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:07.900457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.902096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:07.985909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 949/1885] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:07 2022] PUT /identity/v3/projects/4e4e985135264724919d8e9b049f4c98/users/6327b26ee77e4185b4f7ec8b3e496ee4/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:07.986808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:07.988470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.007220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace75468-fad6-4b6d-866b-d1bdf98b757d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:08.084086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611912ac-6ab6-4ffd-addf-90a7e315287c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:08.085651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b74ca-e6b6-4818-b4f5-4f9076be71c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:08.086453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b74ca-e6b6-4818-b4f5-4f9076be71c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.086823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b74ca-e6b6-4818-b4f5-4f9076be71c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.087188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b74ca-e6b6-4818-b4f5-4f9076be71c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.089070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:08.090000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.090387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.090732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] PATH_INFO: `/v3/projects/de966552e7c34d958a1a19a7a249e4e1` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.091995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de966552e7c34d958a1a19a7a249e4e1)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:08.094067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:08.157567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b74ca-e6b6-4818-b4f5-4f9076be71c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:08.159345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b74ca-e6b6-4818-b4f5-4f9076be71c9 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:08.169709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 937/1886] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:08.172844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.173132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.173402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.202311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:08.204522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] MFA Rules not processed for user `6327b26ee77e4185b4f7ec8b3e496ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:08.205730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.271864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de966552e7c34d958a1a19a7a249e4e1', 'request_id': 'req-6a57e70c-2a8f-4289-9bdb-686f711124a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.286968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de966552e7c34d958a1a19a7a249e4e1', 'request_id': 'req-6a57e70c-2a8f-4289-9bdb-686f711124a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.297310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 938/1887] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:08.299904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:08.301568 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.320492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5baaa5-87f7-4736-89ad-8b869cb58c6b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:08.367421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de966552e7c34d958a1a19a7a249e4e1', 'request_id': 'req-6a57e70c-2a8f-4289-9bdb-686f711124a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.380388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] The token cache is being invalidate because project de966552e7c34d958a1a19a7a249e4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:08.380888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.381607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.382503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:08.383687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.383796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 950/1888] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:07 2022] DELETE /identity/v3/projects/de966552e7c34d958a1a19a7a249e4e1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:08.383889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.384020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] PATH_INFO: `/v3/projects/8f6be5b867704eeab2dbc741fbd7dc6b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.385250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6be5b867704eeab2dbc741fbd7dc6b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:08.387501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:08.387614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:08.389206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.402283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57e70c-2a8f-4289-9bdb-686f711124a2 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:08.414522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:08.415278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.415624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.415964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.416721 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:08.418818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:08.501441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6be5b867704eeab2dbc741fbd7dc6b', 'request_id': 'req-1cec289b-538a-4f60-a6b5-a0b5ea23221a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.507054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6be5b867704eeab2dbc741fbd7dc6b', 'request_id': 'req-1cec289b-538a-4f60-a6b5-a0b5ea23221a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.546298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 951/1889] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:08 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:08.547058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:08.549113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.607348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6be5b867704eeab2dbc741fbd7dc6b', 'request_id': 'req-1cec289b-538a-4f60-a6b5-a0b5ea23221a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.613367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054c8d6-afb1-4b36-b6bb-0560d17ce03c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:08.618066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:08.619001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.619288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.619453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] The token cache is being invalidate because project 8f6be5b867704eeab2dbc741fbd7dc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:08.619552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] PATH_INFO: `/v3/users/746b7d4aca1b42f28ff0265dbb0dd500` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.619701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.620356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.620717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746b7d4aca1b42f28ff0265dbb0dd500)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:08.626972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 939/1890] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:08 2022] DELETE /identity/v3/projects/8f6be5b867704eeab2dbc741fbd7dc6b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:08.627109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:08.627188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:08.627972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.690197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec289b-538a-4f60-a6b5-a0b5ea23221a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:08.741537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:08.742058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.742382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.742658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.746511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.805857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:08.807467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:08.817493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 940/1891] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:08.818443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:08.819738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:08.845838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea7e08-e59c-4cff-a758-19142f08f836 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:08.850390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746b7d4aca1b42f28ff0265dbb0dd500'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.851746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:08.852600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.852891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.853170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.853868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:08.855837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:08.861239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746b7d4aca1b42f28ff0265dbb0dd500'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.862179 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746b7d4aca1b42f28ff0265dbb0dd500'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.862927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746b7d4aca1b42f28ff0265dbb0dd500'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.933325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-690e9b27-ac99-4780-ab92-b8a87965b142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746b7d4aca1b42f28ff0265dbb0dd500'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:08.956554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 952/1892] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:08 2022] DELETE /identity/v3/users/746b7d4aca1b42f28ff0265dbb0dd500 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:08.958243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561a26-aee6-456b-8088-abbb793deddf None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:08.958776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561a26-aee6-456b-8088-abbb793deddf None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:08.959217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561a26-aee6-456b-8088-abbb793deddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:08.975446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 941/1893] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:08 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:08.993820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:08.997782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1f561a26-aee6-456b-8088-abbb793deddf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:09.000428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1f561a26-aee6-456b-8088-abbb793deddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:09.001205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:09.043695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d63c04-f540-4b9b-8dec-4d7c0fe488b8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.099051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 953/1894] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:09.108500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ad2e7-036c-4e04-bcd1-8028f5c36e55 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.108865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ad2e7-036c-4e04-bcd1-8028f5c36e55 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.115924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ad2e7-036c-4e04-bcd1-8028f5c36e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.116144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.116144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.116144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.116144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.116481 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.116481 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.126504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 942/1895] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:09.128885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-551ad2e7-036c-4e04-bcd1-8028f5c36e55 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:09.130171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-551ad2e7-036c-4e04-bcd1-8028f5c36e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:09.130791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.139494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 954/1896] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:09.141756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade510c-bc01-4373-856d-68a8fd228013 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.145076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ad2e7-036c-4e04-bcd1-8028f5c36e55 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.147401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.148393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.148781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.149617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] PATH_INFO: `/v3/projects/c4ae7c9bb6f84565b8998a44962525b9/users/c59fdaefafda449295f7103f990e7af2/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.166450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ae7c9bb6f84565b8998a44962525b9, user_id=c59fdaefafda449295f7103f990e7af2, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.169399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.187308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ad2e7-036c-4e04-bcd1-8028f5c36e55 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.191355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.192069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.192357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.192636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.193366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:09.193680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.195446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.207827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 955/1897] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:09.216706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.226920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32418c8-28e4-4fb7-83e0-de91410663b0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.231685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.232314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.232604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.232883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.233649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.235610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.393815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 943/1898] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:09 2022] PUT /identity/v3/projects/c4ae7c9bb6f84565b8998a44962525b9/users/c59fdaefafda449295f7103f990e7af2/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:09.397778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.424993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 956/1899] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:09 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:09.425918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.475217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808112-9e2d-453e-91cd-067abd0b948b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.504195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d3e7-893c-45bc-89d3-27076ae5c151 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.509477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.515470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.516585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.517440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.518347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.520527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.583915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.584327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.584759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.585020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.585942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.587880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.599651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 944/1900] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:09.600427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.602545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:09.615260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ee7e-70bd-4ba1-97d4-e409efaab3a0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.620573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.621406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.621742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.622022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] PATH_INFO: `/v3/projects/3e6d1091d538438f950fabce45dd7b75` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.623408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6d1091d538438f950fabce45dd7b75)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.625899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.688726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 957/1901] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:09 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:09.688726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.697366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16bfbe-6859-4252-b861-4e41def1544c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.702737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.704186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.704469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.704747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] PATH_INFO: `/v3/projects/c4ae7c9bb6f84565b8998a44962525b9/users/c59fdaefafda449295f7103f990e7af2/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.706831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ae7c9bb6f84565b8998a44962525b9, user_id=c59fdaefafda449295f7103f990e7af2, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.709674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.720243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 958/1902] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:09 2022] PUT /identity/v3/projects/c4ae7c9bb6f84565b8998a44962525b9/users/c59fdaefafda449295f7103f990e7af2/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:09.721142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.784694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc105a2a-a8ae-4b7a-9a93-3d8e3f8f85a8 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:09.829931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6d1091d538438f950fabce45dd7b75', 'request_id': 'req-3a75369c-85ba-40ab-9e6f-dcf46deb5499'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:09.845272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6d1091d538438f950fabce45dd7b75', 'request_id': 'req-3a75369c-85ba-40ab-9e6f-dcf46deb5499'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:09.927031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a288f0-14af-4ac9-bda1-0a0a65e26103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:09.927723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a288f0-14af-4ac9-bda1-0a0a65e26103 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.939453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a288f0-14af-4ac9-bda1-0a0a65e26103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.939453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a288f0-14af-4ac9-bda1-0a0a65e26103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.939453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a288f0-14af-4ac9-bda1-0a0a65e26103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:09.939453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a288f0-14af-4ac9-bda1-0a0a65e26103 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:09.951233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 959/1903] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:09.955261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0354-107d-4acc-9b39-dd5df5635e4c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:09.955570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0354-107d-4acc-9b39-dd5df5635e4c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:09.955854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0354-107d-4acc-9b39-dd5df5635e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:09.956929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6d1091d538438f950fabce45dd7b75', 'request_id': 'req-3a75369c-85ba-40ab-9e6f-dcf46deb5499'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:09.973806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] The token cache is being invalidate because project 3e6d1091d538438f950fabce45dd7b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:09.974142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:09.975451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:09.976493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 945/1904] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:09 2022] DELETE /identity/v3/projects/3e6d1091d538438f950fabce45dd7b75 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:09.980616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:09.982421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:09.989164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-732f0354-107d-4acc-9b39-dd5df5635e4c None None] MFA Rules not processed for user `c59fdaefafda449295f7103f990e7af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:09.991201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-732f0354-107d-4acc-9b39-dd5df5635e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:10.001312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75369c-85ba-40ab-9e6f-dcf46deb5499 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.010469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295f5b-626b-4a83-a734-a759e0260151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.010469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295f5b-626b-4a83-a734-a759e0260151 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.010469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295f5b-626b-4a83-a734-a759e0260151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.010469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295f5b-626b-4a83-a734-a759e0260151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.011825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295f5b-626b-4a83-a734-a759e0260151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.013879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295f5b-626b-4a83-a734-a759e0260151 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.026776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 946/1905] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:10.033504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126140-4679-4294-b405-dbc7d1fe2991 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.034138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126140-4679-4294-b405-dbc7d1fe2991 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.035091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126140-4679-4294-b405-dbc7d1fe2991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.060808 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-73126140-4679-4294-b405-dbc7d1fe2991 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:10.062822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-73126140-4679-4294-b405-dbc7d1fe2991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:10.082581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 947/1906] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:10.083611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126140-4679-4294-b405-dbc7d1fe2991 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.104391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126140-4679-4294-b405-dbc7d1fe2991 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.112100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.113914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.114201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.114515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] PATH_INFO: `/v3/projects/26b35ec559dd448fb201300acbaf8780/users/b27a87d986b944628728eb05914f7aa4/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.119275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 960/1907] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:10.120937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.121236 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.121832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.139857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b35ec559dd448fb201300acbaf8780, user_id=b27a87d986b944628728eb05914f7aa4, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.142667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:10.142948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.143922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:10.152800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 961/1908] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:10.153761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.155156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:10.255467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913e4e-596e-4a87-92c2-f8d1e1659c4c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.259660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e3b3-63e1-43a9-be4f-dcc6c42525c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.260164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e3b3-63e1-43a9-be4f-dcc6c42525c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.260458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e3b3-63e1-43a9-be4f-dcc6c42525c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.260771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e3b3-63e1-43a9-be4f-dcc6c42525c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.299295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 948/1909] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:10 2022] PUT /identity/v3/projects/26b35ec559dd448fb201300acbaf8780/users/b27a87d986b944628728eb05914f7aa4/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:10.300174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.307321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e3b3-63e1-43a9-be4f-dcc6c42525c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.311139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e3b3-63e1-43a9-be4f-dcc6c42525c4 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.331464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 962/1910] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:10.333211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.333505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.333790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.371405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] MFA Rules not processed for user `b27a87d986b944628728eb05914f7aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:10.373554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:10.402369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d7caa-1275-40d1-8a4b-f154d1a71e1c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.412081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.413253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.413689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.414187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.415136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:10.415555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.417530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.437931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 949/1911] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:10.444648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.455947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f2e-bdac-4b3f-a31b-614c24b1a1fe admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.461828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.462622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.462906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.463175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.463998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.465920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.477519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 963/1912] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:10.494605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.496021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:10.553368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d473a-e19e-4008-ac4d-a4e9f7405b34 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.557299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.557955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.558263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.558560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.567665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.569100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.578071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 964/1913] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:10.597908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.616237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 950/1914] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:10 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:10.619275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.621166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44226-5041-4e64-9c20-2478ff2eaf8f service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.687906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:10.713350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cc72a-c888-48c0-a209-106022e9b0bb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.721043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.721684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.722043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.722598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.723506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.724762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.725781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.726044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.726193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.726578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] PATH_INFO: `/v3/users/b27a87d986b944628728eb05914f7aa4` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.727855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27a87d986b944628728eb05914f7aa4)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:10.730113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:10.826835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 951/1915] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:10 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:10.827715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:10.903012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c660a-43a9-453f-bb50-29bb467077d0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:10.905091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27a87d986b944628728eb05914f7aa4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:10.907749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b96d-a84e-4a0f-b47b-77be21a25eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:10.908895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b96d-a84e-4a0f-b47b-77be21a25eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:10.909234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b96d-a84e-4a0f-b47b-77be21a25eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:10.909514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b96d-a84e-4a0f-b47b-77be21a25eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:10.911648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-de37b96d-a84e-4a0f-b47b-77be21a25eb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:10.914767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27a87d986b944628728eb05914f7aa4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:10.916190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27a87d986b944628728eb05914f7aa4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:10.916774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27a87d986b944628728eb05914f7aa4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:10.983490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27a87d986b944628728eb05914f7aa4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:11.021271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37b96d-a84e-4a0f-b47b-77be21a25eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.022592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 965/1916] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:10 2022] DELETE /identity/v3/users/b27a87d986b944628728eb05914f7aa4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:11.023606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.024472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37b96d-a84e-4a0f-b47b-77be21a25eb0 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.025203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:11.036533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 952/1917] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:11.038159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987a04-03dd-4875-b545-beaa46b4ffbf None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.038549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987a04-03dd-4875-b545-beaa46b4ffbf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.038839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987a04-03dd-4875-b545-beaa46b4ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.060728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fd987a04-03dd-4875-b545-beaa46b4ffbf None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:11.064056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fd987a04-03dd-4875-b545-beaa46b4ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:11.163976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543bc2-630a-4038-bce9-ba848fa3ca9f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:11.174710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:11.176257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.178838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.179282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.182250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 953/1918] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:11.182971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.184744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.201587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987a04-03dd-4875-b545-beaa46b4ffbf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.202400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 966/1919] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:11.209452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.214428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:11.215025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987a04-03dd-4875-b545-beaa46b4ffbf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:11.223047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:11.223868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.224062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.224344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.225462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.226903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.242684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 954/1920] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:11.252182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.256783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1fc0-5516-4323-9c08-200f4c99d035 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:11.263334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:11.264677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.265695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.266805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] PATH_INFO: `/v3/projects/2b5937aed92045be93a387d71aa0c27b/users/b41d07cf4e354e57a97e4ae905b2f6e5/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.299960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5937aed92045be93a387d71aa0c27b, user_id=b41d07cf4e354e57a97e4ae905b2f6e5, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.302913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.316706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad97e6-aff7-4ecf-ae11-939e0e1d1270 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:11.321085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4e92-3761-4fed-8627-2efe4b4beef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:11.321791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4e92-3761-4fed-8627-2efe4b4beef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.322101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4e92-3761-4fed-8627-2efe4b4beef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.322481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4e92-3761-4fed-8627-2efe4b4beef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.333423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f4e92-3761-4fed-8627-2efe4b4beef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.334973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f4e92-3761-4fed-8627-2efe4b4beef5 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.345710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 967/1921] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:11.409461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 955/1922] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:11 2022] PUT /identity/v3/projects/2b5937aed92045be93a387d71aa0c27b/users/b41d07cf4e354e57a97e4ae905b2f6e5/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:11.419785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e3b4-144f-4653-ad1d-d1b00476dd22 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.420077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e3b4-144f-4653-ad1d-d1b00476dd22 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.420366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e3b4-144f-4653-ad1d-d1b00476dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.451659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-43b5e3b4-144f-4653-ad1d-d1b00476dd22 None None] MFA Rules not processed for user `b41d07cf4e354e57a97e4ae905b2f6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:11.458539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-43b5e3b4-144f-4653-ad1d-d1b00476dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:11.538422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 968/1923] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:11.539242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.636375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901016-b401-4a63-be3d-79ed574cece4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:11.646767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:11.647739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.648044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.648291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.649000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.655434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.801717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 956/1924] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:11 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:11.803156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e3b4-144f-4653-ad1d-d1b00476dd22 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.814483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e3b4-144f-4653-ad1d-d1b00476dd22 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:11.870857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:11.871539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.871828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.872293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.873006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.874978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.933809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.935490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:11.948963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8cb0-095a-4c65-be68-e5b00972cfc4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:11.954969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:11.955840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:11.956132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:11.956412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] PATH_INFO: `/v3/projects/26b35ec559dd448fb201300acbaf8780` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:11.957631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b35ec559dd448fb201300acbaf8780)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:11.959588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:11.968092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 969/1925] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:11 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:11.980053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:11.994703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a93f-2fa0-4ff0-9431-3c8f697996aa admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.001129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.005670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.005670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.005670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.005670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.006538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.019381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 970/1926] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:12.023866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.037832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198488f-04c6-4365-8652-b681b91c3073 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.042727 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.043629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.043908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.044192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] PATH_INFO: `/v3/projects/f63031c1358c4136848d3b71917b708a/users/20951c7c6aa84bdbab1e253927e8e4c1/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.062260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63031c1358c4136848d3b71917b708a, user_id=20951c7c6aa84bdbab1e253927e8e4c1, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.065075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.163531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 971/1927] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:12 2022] PUT /identity/v3/projects/f63031c1358c4136848d3b71917b708a/users/20951c7c6aa84bdbab1e253927e8e4c1/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:12.167653 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.176132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b35ec559dd448fb201300acbaf8780', 'request_id': 'req-533f26e9-f39b-480a-aa8b-0a2563b03a8f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:12.189581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b35ec559dd448fb201300acbaf8780', 'request_id': 'req-533f26e9-f39b-480a-aa8b-0a2563b03a8f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:12.218565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:12.242886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd845-2e59-46c3-bbbd-4dfae9bf9210 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.258840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b35ec559dd448fb201300acbaf8780', 'request_id': 'req-533f26e9-f39b-480a-aa8b-0a2563b03a8f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:12.272824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] The token cache is being invalidate because project 26b35ec559dd448fb201300acbaf8780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:12.273358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:12.274096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-533f26e9-f39b-480a-aa8b-0a2563b03a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:12.279606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 957/1928] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:11 2022] DELETE /identity/v3/projects/26b35ec559dd448fb201300acbaf8780 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:12.282460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089af43-dbe9-4b8c-895f-380b8c40e8ef None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.282632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089af43-dbe9-4b8c-895f-380b8c40e8ef None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.284138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089af43-dbe9-4b8c-895f-380b8c40e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.302558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a089af43-dbe9-4b8c-895f-380b8c40e8ef None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:12.303865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a089af43-dbe9-4b8c-895f-380b8c40e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:12.309654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.310144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.310454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.310736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.311507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.313462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.323972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 972/1929] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:12.327878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.330127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:12.346084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c22c7-a1bb-44dd-9246-0edc7f65e82d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.351999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51deeaed-3506-4b8e-a62d-588f5b11c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.352659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeaed-3506-4b8e-a62d-588f5b11c380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.352989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeaed-3506-4b8e-a62d-588f5b11c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.353270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeaed-3506-4b8e-a62d-588f5b11c380 admin admin] PATH_INFO: `/v3/projects/f63031c1358c4136848d3b71917b708a/users/20951c7c6aa84bdbab1e253927e8e4c1/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.356869 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51deeaed-3506-4b8e-a62d-588f5b11c380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63031c1358c4136848d3b71917b708a, user_id=20951c7c6aa84bdbab1e253927e8e4c1, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.360664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51deeaed-3506-4b8e-a62d-588f5b11c380 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.372443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 973/1930] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:12 2022] PUT /identity/v3/projects/f63031c1358c4136848d3b71917b708a/users/20951c7c6aa84bdbab1e253927e8e4c1/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:12.381823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.382116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.382400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.391420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 958/1931] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:12.393218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e73c2-0281-406a-b1d8-ad72578b75ff None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.393503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e73c2-0281-406a-b1d8-ad72578b75ff None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.393778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e73c2-0281-406a-b1d8-ad72578b75ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.413765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c38e73c2-0281-406a-b1d8-ad72578b75ff None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:12.415129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c38e73c2-0281-406a-b1d8-ad72578b75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:12.423898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] MFA Rules not processed for user `20951c7c6aa84bdbab1e253927e8e4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:12.425243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:12.484970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 959/1932] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:12.488911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e73c2-0281-406a-b1d8-ad72578b75ff None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.498595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e73c2-0281-406a-b1d8-ad72578b75ff None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.499241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 974/1933] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:12.510767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.517639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.517639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.517893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:12.517984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.517984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.517984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:12.517984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.517984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.532905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 960/1934] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:45:12.534795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.546437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e62e51-e064-4a08-accc-d61f2754c0a2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.551970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.552824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.553222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.553613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.554444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.556509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.564408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:12.606351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56f60-ce38-4f18-a103-4a21ac344ffc None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.606351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.606351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.606934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.607343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.620992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.622714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.636065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 975/1935] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:12.673590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 961/1936] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:12 2022] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:12.676401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.688618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636bc60-7a6c-4708-aa14-7a3c807556da service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.769417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.770103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.770447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.770731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.771433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.773509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.849763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.880910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 976/1937] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:12 2022] POST /identity/v3/users => generated 281 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:12.882301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.901860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aee897-eda2-491a-9259-a01e134ea537 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.928061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.929909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.932646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.933139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.934092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.940943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.951693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 977/1938] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:12.955805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b39ed-e181-46a1-83df-2fd603b24af1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.957115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:12.966440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869de5dd-581c-4398-baeb-daf62e24ab9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.967374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de5dd-581c-4398-baeb-daf62e24ab9a service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.969942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5ce2-4778-405e-91d2-4ff14fbfc730 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:12.970719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de5dd-581c-4398-baeb-daf62e24ab9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.971326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de5dd-581c-4398-baeb-daf62e24ab9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.973892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-869de5dd-581c-4398-baeb-daf62e24ab9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:12.974696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:12.975481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:12.975865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:12.976247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:12.977202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:12.978935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:12.997858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 978/1939] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:12.997858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:13.005280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5981c-faf8-42c8-85ad-ed5ecc3112c9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:13.010401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:13.011450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:13.011803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:13.012930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] PATH_INFO: `/v3/projects/83927944b73d4d058bbe1d9ee1291682/users/dc52d946b1aa4182a9a04727fd46355e/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:13.036908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83927944b73d4d058bbe1d9ee1291682, user_id=dc52d946b1aa4182a9a04727fd46355e, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:13.040058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:13.080140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869de5dd-581c-4398-baeb-daf62e24ab9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:13.081671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869de5dd-581c-4398-baeb-daf62e24ab9a service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:13.091873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 962/1940] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:13.122735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 979/1941] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:12 2022] PUT /identity/v3/projects/83927944b73d4d058bbe1d9ee1291682/users/dc52d946b1aa4182a9a04727fd46355e/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:13.133312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785e02-9c07-45af-82ef-f40c59c39346 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:13.133607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785e02-9c07-45af-82ef-f40c59c39346 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:13.133905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785e02-9c07-45af-82ef-f40c59c39346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:13.165429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-46785e02-9c07-45af-82ef-f40c59c39346 None None] MFA Rules not processed for user `dc52d946b1aa4182a9a04727fd46355e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:13.166821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-46785e02-9c07-45af-82ef-f40c59c39346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:13.250690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 963/1942] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:13.928704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:13.979058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b2bc-a8b8-4bde-b964-65a260cf2643 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:13.985296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e4a75-0cc3-48d8-aca3-e511b1e35819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:13.986147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e4a75-0cc3-48d8-aca3-e511b1e35819 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:13.986439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e4a75-0cc3-48d8-aca3-e511b1e35819 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:13.986712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e4a75-0cc3-48d8-aca3-e511b1e35819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:14.000299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e4a75-0cc3-48d8-aca3-e511b1e35819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:14.002908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e4a75-0cc3-48d8-aca3-e511b1e35819 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:14.049515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 980/1943] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:14.050143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46785e02-9c07-45af-82ef-f40c59c39346 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:14.138927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46785e02-9c07-45af-82ef-f40c59c39346 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:14.144713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:14.145757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:14.146183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:14.146493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] PATH_INFO: `/v3/users/dc52d946b1aa4182a9a04727fd46355e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:14.147738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc52d946b1aa4182a9a04727fd46355e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:14.149757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:14.463705 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc52d946b1aa4182a9a04727fd46355e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:14.472067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc52d946b1aa4182a9a04727fd46355e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:14.528334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:14.591467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc52d946b1aa4182a9a04727fd46355e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:14.604742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc52d946b1aa4182a9a04727fd46355e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:14.605502 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc52d946b1aa4182a9a04727fd46355e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:14.611936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 964/1944] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:14 2022] DELETE /identity/v3/users/dc52d946b1aa4182a9a04727fd46355e => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:14.616330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:14.616634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:14.616910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:14.639405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:14.642265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:14.725313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 981/1945] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:14.737359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:14.738882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:14.815259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1acd-cdc8-4079-a8fa-83bfe8794a00 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:14.819463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:14.821064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:14.821064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:14.821288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:14.837460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:14.840548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:14.851028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 965/1946] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:15.115540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:15.466191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:15.467783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:15.481243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb082f2-4b85-4797-b689-d82be9a517eb None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:15.485968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:15.487012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:15.487379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:15.487731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] PATH_INFO: `/v3/users/a3a7b2b985a14b2d800e619b975f924a` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:15.489060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a7b2b985a14b2d800e619b975f924a)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:15.491099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:15.533831 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:15.535421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:15.562003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227ea89-88ae-4838-9431-5cbf55ea69d5 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:15.569410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:15.570486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:15.570938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:15.571228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] PATH_INFO: `/v3/projects/83927944b73d4d058bbe1d9ee1291682` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:15.572473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=83927944b73d4d058bbe1d9ee1291682)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:15.574519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:15.776121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a7b2b985a14b2d800e619b975f924a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.783851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a7b2b985a14b2d800e619b975f924a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.784568 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83927944b73d4d058bbe1d9ee1291682', 'request_id': 'req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.784907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a7b2b985a14b2d800e619b975f924a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.785704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a7b2b985a14b2d800e619b975f924a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.790553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83927944b73d4d058bbe1d9ee1291682', 'request_id': 'req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.876509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8cad215c-bbbf-4e11-b562-3f170d928a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a7b2b985a14b2d800e619b975f924a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.921453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 982/1947] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:15 2022] DELETE /identity/v3/users/a3a7b2b985a14b2d800e619b975f924a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:15.924483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:15.925203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:15.925203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:15.933497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83927944b73d4d058bbe1d9ee1291682', 'request_id': 'req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.952357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] The token cache is being invalidate because project 83927944b73d4d058bbe1d9ee1291682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:15.952820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.953824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40fc65f1-e45d-4606-bdb8-3fae8ecc00ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:15.955534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 966/1948] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:15 2022] DELETE /identity/v3/projects/83927944b73d4d058bbe1d9ee1291682 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:15.960529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d5a0-c937-4e5f-99b5-d646153710fb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:15.961130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d5a0-c937-4e5f-99b5-d646153710fb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:15.963777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d5a0-c937-4e5f-99b5-d646153710fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:15.963888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:15.964266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:15.990268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ff83d5a0-c937-4e5f-99b5-d646153710fb None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:15.992248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ff83d5a0-c937-4e5f-99b5-d646153710fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:16.104834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 967/1949] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:16.114837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789edfe-50ee-482a-a019-650e295ecd1d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.115132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789edfe-50ee-482a-a019-650e295ecd1d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.115415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789edfe-50ee-482a-a019-650e295ecd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.116502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 983/1950] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:16.117503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.119055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:16.142087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7789edfe-50ee-482a-a019-650e295ecd1d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:16.143959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7789edfe-50ee-482a-a019-650e295ecd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:16.154627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 968/1951] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:16.165926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789edfe-50ee-482a-a019-650e295ecd1d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.185381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789edfe-50ee-482a-a019-650e295ecd1d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.205715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8b11-9f4d-4449-9293-65ac63294ad1 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.210531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.211191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.213944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.213944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.217183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.217831 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.218189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.218566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.221134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:16.221526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.224350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.225330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.226472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.240925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 984/1952] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:16.251731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 969/1953] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:16.253156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.266420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893cc4e-90f2-4217-9a5c-42a94d705730 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.272400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.273211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.273510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.273793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.274727 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.276978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.404546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 985/1954] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:16 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:16.411280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.425025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630baeb-16d8-4e34-82a1-e7875c060cdf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.538190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.538190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.538190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.538190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.540416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.540416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.643944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.652618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:16.679530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826491ab-3df4-4d01-8c34-f1935d361b7a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.687575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 970/1955] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:16 2022] POST /identity/v3/users => generated 285 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:16.688506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.689112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.690324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.690811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.691237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] PATH_INFO: `/v3/users/b41d07cf4e354e57a97e4ae905b2f6e5` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.692674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41d07cf4e354e57a97e4ae905b2f6e5)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.695127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.714930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81878c3f-7996-4268-93e7-9004c7f846f2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.721225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.722865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.723541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.723972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.725025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.727153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.744942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 971/1956] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:16.746092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.760508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f163-2db3-4202-808d-f98d898c85bd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.772976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.774033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.775920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.776724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.778375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.780983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.782164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:16.802100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 972/1957] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:16.803365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.816499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3bd0e-b6fb-4c92-bd88-def52380c9ac admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:16.824757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:16.824757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:16.824757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:16.824757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] PATH_INFO: `/v3/projects/3f6a3e687fcc40ceb8f89fc4cc9755ba/users/852e8ed4edd54fdb8f0b23b0c07b4700/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:16.843413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6a3e687fcc40ceb8f89fc4cc9755ba, user_id=852e8ed4edd54fdb8f0b23b0c07b4700, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:16.847734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:16.952218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 973/1958] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:16 2022] PUT /identity/v3/projects/3f6a3e687fcc40ceb8f89fc4cc9755ba/users/852e8ed4edd54fdb8f0b23b0c07b4700/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:16.952218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:16.952218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:16.961258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41d07cf4e354e57a97e4ae905b2f6e5'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:16.973862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41d07cf4e354e57a97e4ae905b2f6e5'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:16.974472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41d07cf4e354e57a97e4ae905b2f6e5'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:16.975204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41d07cf4e354e57a97e4ae905b2f6e5'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.046022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea569-6fe8-4f34-baf1-1bdf283734d9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:17.051751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:17.056967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:17.057052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-386c6e4e-465b-4161-8a5b-670f681afa84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41d07cf4e354e57a97e4ae905b2f6e5'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.060904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:17.061358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] PATH_INFO: `/v3/projects/e90933cd7f334a0e8feebf3b2a933486` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:17.063567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90933cd7f334a0e8feebf3b2a933486)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:17.066041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:17.080275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 986/1959] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:16 2022] DELETE /identity/v3/users/b41d07cf4e354e57a97e4ae905b2f6e5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:17.081757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453c98-11a2-4a56-b2dd-ad3de99c83a0 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:17.082125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453c98-11a2-4a56-b2dd-ad3de99c83a0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:17.082521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453c98-11a2-4a56-b2dd-ad3de99c83a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:17.114435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-11453c98-11a2-4a56-b2dd-ad3de99c83a0 None None] MFA Rules not processed for user `852e8ed4edd54fdb8f0b23b0c07b4700`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:17.115891 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-11453c98-11a2-4a56-b2dd-ad3de99c83a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:17.185140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 987/1960] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:17.186447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:17.186733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:17.187015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:17.210995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90933cd7f334a0e8feebf3b2a933486', 'request_id': 'req-d3502890-2a4d-445c-bf1d-0c507a2909dd'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.216881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90933cd7f334a0e8feebf3b2a933486', 'request_id': 'req-d3502890-2a4d-445c-bf1d-0c507a2909dd'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.217373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:17.218652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:17.284468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 988/1961] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:17.284468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:17.285626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:17.337639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:17.343644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036609-a9db-4f9e-9249-4861a822fa36 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:17.347278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:17.347931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:17.348301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:17.348584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:17.361527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90933cd7f334a0e8feebf3b2a933486', 'request_id': 'req-d3502890-2a4d-445c-bf1d-0c507a2909dd'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.376474 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] The token cache is being invalidate because project e90933cd7f334a0e8feebf3b2a933486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:17.376474 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.377245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.381940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 974/1962] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:16 2022] DELETE /identity/v3/projects/e90933cd7f334a0e8feebf3b2a933486 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:17.381940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:17.381940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:17.410091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:17.411853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:17.435059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 989/1963] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:17.437078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:17.440694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:17.454651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502890-2a4d-445c-bf1d-0c507a2909dd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:17.458922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:17.459586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:17.459799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9334bb-bb58-4ded-952c-d6f700029ae3 service glance] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:17.459912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:17.460439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:17.462761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:17.465012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:17.466062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:17.466617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:17.467063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] PATH_INFO: `/v3/users/9b2b49ebbd23488f8d8ac8ba49890869` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:17.468479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2b49ebbd23488f8d8ac8ba49890869)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:17.470507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:17.477599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:17.480147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:17.493556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 975/1964] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:17.713056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2b49ebbd23488f8d8ac8ba49890869'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.720567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2b49ebbd23488f8d8ac8ba49890869'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.721300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2b49ebbd23488f8d8ac8ba49890869'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.721908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2b49ebbd23488f8d8ac8ba49890869'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.801673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2b49ebbd23488f8d8ac8ba49890869'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:17.820126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 990/1965] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:17 2022] DELETE /identity/v3/users/9b2b49ebbd23488f8d8ac8ba49890869 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:17.962708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:17.966810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:18.001458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ffbeb-c146-41c6-abf9-f41339fb353d service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:18.118275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:18.119154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:18.119436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:18.119743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] PATH_INFO: `/v3/projects/2b5937aed92045be93a387d71aa0c27b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:18.121134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5937aed92045be93a387d71aa0c27b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:18.124028 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:18.284777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5937aed92045be93a387d71aa0c27b', 'request_id': 'req-411665ee-452b-49b4-8b33-3ac0f743d0bf'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.293772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5937aed92045be93a387d71aa0c27b', 'request_id': 'req-411665ee-452b-49b4-8b33-3ac0f743d0bf'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.465029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5937aed92045be93a387d71aa0c27b', 'request_id': 'req-411665ee-452b-49b4-8b33-3ac0f743d0bf'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.474680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:18.474680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:18.513334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] The token cache is being invalidate because project 2b5937aed92045be93a387d71aa0c27b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:18.513753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.514870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.516445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd81792-7d6b-4a69-8199-ddba9d8acb2e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:18.518286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 976/1966] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:17 2022] DELETE /identity/v3/projects/2b5937aed92045be93a387d71aa0c27b => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:18.523305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:18.525603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:18.601926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:18.602833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:18.603120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:18.603397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] PATH_INFO: `/v3/projects/6c9ce1ec5d2d40089a376183e6ae5233` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:18.604719 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9ce1ec5d2d40089a376183e6ae5233)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:18.605121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411665ee-452b-49b4-8b33-3ac0f743d0bf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:18.606693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:18.611137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:18.612270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:18.612752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:18.613658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] PATH_INFO: `/v3/users/20951c7c6aa84bdbab1e253927e8e4c1` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:18.615348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20951c7c6aa84bdbab1e253927e8e4c1)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:18.617473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:18.710591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9ce1ec5d2d40089a376183e6ae5233', 'request_id': 'req-133793f5-6e8a-496a-8d11-450f6bae8231'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.716131 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9ce1ec5d2d40089a376183e6ae5233', 'request_id': 'req-133793f5-6e8a-496a-8d11-450f6bae8231'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.768743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:18.813510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9ce1ec5d2d40089a376183e6ae5233', 'request_id': 'req-133793f5-6e8a-496a-8d11-450f6bae8231'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.824950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] The token cache is being invalidate because project 6c9ce1ec5d2d40089a376183e6ae5233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:18.825242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.825885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-133793f5-6e8a-496a-8d11-450f6bae8231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.827562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 991/1967] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:18 2022] DELETE /identity/v3/projects/6c9ce1ec5d2d40089a376183e6ae5233 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:18.833166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:18.833461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:18.833745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:18.854876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:18.856098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:18.870906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20951c7c6aa84bdbab1e253927e8e4c1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.879686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20951c7c6aa84bdbab1e253927e8e4c1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.935403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 992/1968] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:18.935403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:18.936084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:18.951382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041530aa-c0c3-47b2-93ca-d5ca459443fa None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:18.957349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:18.958451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:18.961816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:18.961816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] PATH_INFO: `/v3/users/7d99b5e07024444f899a43ddfb7d0e62` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:18.962440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d99b5e07024444f899a43ddfb7d0e62)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:18.965363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:18.983427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20951c7c6aa84bdbab1e253927e8e4c1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.997961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20951c7c6aa84bdbab1e253927e8e4c1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:18.998821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5d0d9b58-4bbf-4d8f-a838-270b5fd3f10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20951c7c6aa84bdbab1e253927e8e4c1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:19.006256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 977/1969] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:18 2022] DELETE /identity/v3/users/20951c7c6aa84bdbab1e253927e8e4c1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:19.007882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045b44-9552-4fa3-bdf4-5fec2101dcde None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:19.008172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045b44-9552-4fa3-bdf4-5fec2101dcde None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:19.008449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045b44-9552-4fa3-bdf4-5fec2101dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:19.027248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a6045b44-9552-4fa3-bdf4-5fec2101dcde None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:19.028517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a6045b44-9552-4fa3-bdf4-5fec2101dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:19.085249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:19.168907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 978/1970] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:19.176109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6045b44-9552-4fa3-bdf4-5fec2101dcde None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:19.188956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6045b44-9552-4fa3-bdf4-5fec2101dcde None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:19.195006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:19.199515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:19.199515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:19.199515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:19.199515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:19.199515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:19.199972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:19.216833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 979/1971] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:19.217895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:19.230464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9471afc-6a8e-449a-bdae-bac60eacae62 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:19.238354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:19.238354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:19.238354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:19.238707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:19.239406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:19.241405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:19.336340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d99b5e07024444f899a43ddfb7d0e62'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:19.343160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d99b5e07024444f899a43ddfb7d0e62'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:19.344698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d99b5e07024444f899a43ddfb7d0e62'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:19.352121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d99b5e07024444f899a43ddfb7d0e62'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:19.403919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 980/1972] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:19 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:19.403919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:19.413173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:19.476319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d99b5e07024444f899a43ddfb7d0e62'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:19.541549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 993/1973] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:18 2022] DELETE /identity/v3/users/7d99b5e07024444f899a43ddfb7d0e62 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:19.541549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:19.541549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:19.583726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7e238-9cfd-4e4f-ac1a-5438a2c52ffd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:19.631784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bac02-655e-4d5a-8585-0bc79a1eb487 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:19.638631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:19.639824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:19.640215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:19.641166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:19.642092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:19.645063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:19.666571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:19.667440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:19.668106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:19.668106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] PATH_INFO: `/v3/users/6327b26ee77e4185b4f7ec8b3e496ee4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:19.669233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6327b26ee77e4185b4f7ec8b3e496ee4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:19.671588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:19.745363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 994/1974] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:19 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:19.746547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:19.748402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:19.763620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f56db4-fc95-45e6-9985-cd847ec0093a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:19.772365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:19.773254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:19.773845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:19.774192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] PATH_INFO: `/v3/projects/f63031c1358c4136848d3b71917b708a` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:19.775695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63031c1358c4136848d3b71917b708a)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:19.777652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:19.913945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6327b26ee77e4185b4f7ec8b3e496ee4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:19.923451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6327b26ee77e4185b4f7ec8b3e496ee4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.014028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63031c1358c4136848d3b71917b708a', 'request_id': 'req-56955785-4b0d-4110-b248-fa97a7119317'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.019685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63031c1358c4136848d3b71917b708a', 'request_id': 'req-56955785-4b0d-4110-b248-fa97a7119317'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.048059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6327b26ee77e4185b4f7ec8b3e496ee4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.061503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6327b26ee77e4185b4f7ec8b3e496ee4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.062522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6327b26ee77e4185b4f7ec8b3e496ee4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.068405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 981/1975] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:19 2022] DELETE /identity/v3/users/6327b26ee77e4185b4f7ec8b3e496ee4 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:20.069192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.070533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.138992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63031c1358c4136848d3b71917b708a', 'request_id': 'req-56955785-4b0d-4110-b248-fa97a7119317'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.141841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc0f8d-b826-442d-8193-be4591af7a4c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.147056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.147739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.148030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.150574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.150574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.150959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.152862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] The token cache is being invalidate because project f63031c1358c4136848d3b71917b708a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:20.153160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.153822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-56955785-4b0d-4110-b248-fa97a7119317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.155405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 995/1976] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:19 2022] DELETE /identity/v3/projects/f63031c1358c4136848d3b71917b708a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:20.157407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a899a6-061e-40bc-ace4-d336f05276a9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.157582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a899a6-061e-40bc-ace4-d336f05276a9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.157858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a899a6-061e-40bc-ace4-d336f05276a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.163257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 982/1977] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:20.164105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.167165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.178466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-16a899a6-061e-40bc-ace4-d336f05276a9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:20.181944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-16a899a6-061e-40bc-ace4-d336f05276a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.182240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe9417-1d61-4aa7-8975-113d458cbc4e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.187092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.187929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.188219 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.188526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] PATH_INFO: `/v3/projects/cc319879922d44af97106ac334881d0e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.188830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 996/1978] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:20.189721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc319879922d44af97106ac334881d0e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.190111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.190589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.190919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.194911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.209637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:20.211067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.219612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 997/1979] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:20.220537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.221843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.233832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b35cf-7199-4045-86fe-acab2715fd43 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.239281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.239938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.240241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.240519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.241272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.242918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.254737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 998/1980] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:20.255733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.258136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.315455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9f1e-d80f-4910-a9b8-13f08ba229cf admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.328354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc319879922d44af97106ac334881d0e', 'request_id': 'req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.335170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc319879922d44af97106ac334881d0e', 'request_id': 'req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.369189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.369913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.370285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.370570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.401442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc319879922d44af97106ac334881d0e', 'request_id': 'req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.422765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] The token cache is being invalidate because project cc319879922d44af97106ac334881d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:20.423033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.423757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-df46bb4a-e90f-4f43-ba1e-1164a5557f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:20.425392 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 983/1981] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:20 2022] DELETE /identity/v3/projects/cc319879922d44af97106ac334881d0e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:20.428854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6957-100d-4fd0-a7cb-625c45d80f21 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.428854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6957-100d-4fd0-a7cb-625c45d80f21 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.428854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6957-100d-4fd0-a7cb-625c45d80f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.433376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.434904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.444787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-364f6957-100d-4fd0-a7cb-625c45d80f21 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:20.444929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 999/1982] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:20.445756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.445979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-364f6957-100d-4fd0-a7cb-625c45d80f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.455767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 984/1983] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:20.457020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5d25-eb9f-4840-a913-f5b5151b7278 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.457236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5d25-eb9f-4840-a913-f5b5151b7278 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.457517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5d25-eb9f-4840-a913-f5b5151b7278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.458903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad78e3-f96d-4bb9-8234-bd2273b7fb92 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.464672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.466298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.466590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.466879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] PATH_INFO: `/v3/projects/632eb11fd07e441599711e5da2cb9b44/users/fd4364164b99472099cc7abef567bfb5/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.479116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-71be5d25-eb9f-4840-a913-f5b5151b7278 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:20.480835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-71be5d25-eb9f-4840-a913-f5b5151b7278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.485116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=632eb11fd07e441599711e5da2cb9b44, user_id=fd4364164b99472099cc7abef567bfb5, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.488461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.498066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 985/1984] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:20.504117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5d25-eb9f-4840-a913-f5b5151b7278 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.516524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5d25-eb9f-4840-a913-f5b5151b7278 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.520993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deda9a-f378-49be-aceb-d7f86a570ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.522406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deda9a-f378-49be-aceb-d7f86a570ada admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.523168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deda9a-f378-49be-aceb-d7f86a570ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.523450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deda9a-f378-49be-aceb-d7f86a570ada admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.524188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7deda9a-f378-49be-aceb-d7f86a570ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:20.524499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7deda9a-f378-49be-aceb-d7f86a570ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.526425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7deda9a-f378-49be-aceb-d7f86a570ada admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.548180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 986/1985] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:20.548180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68d32-80ad-4018-b7ce-1145a1e5b354 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.548180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68d32-80ad-4018-b7ce-1145a1e5b354 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.548180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68d32-80ad-4018-b7ce-1145a1e5b354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.573342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d8f68d32-80ad-4018-b7ce-1145a1e5b354 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:20.574603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d8f68d32-80ad-4018-b7ce-1145a1e5b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.585349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 987/1986] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:20.586337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68d32-80ad-4018-b7ce-1145a1e5b354 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.596598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68d32-80ad-4018-b7ce-1145a1e5b354 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.597192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1000/1987] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:20 2022] PUT /identity/v3/projects/632eb11fd07e441599711e5da2cb9b44/users/fd4364164b99472099cc7abef567bfb5/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:20.598273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.681421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0133b-5901-4131-b010-774e6937ea0d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.686949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1c01d-9a4f-4f4a-a444-e98fee6c703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.687769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1c01d-9a4f-4f4a-a444-e98fee6c703e admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.687892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.688177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1c01d-9a4f-4f4a-a444-e98fee6c703e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.688457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1c01d-9a4f-4f4a-a444-e98fee6c703e admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.689239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1c01d-9a4f-4f4a-a444-e98fee6c703e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:20.689362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.689983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1c01d-9a4f-4f4a-a444-e98fee6c703e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.690096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.690096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.690629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.691273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1c01d-9a4f-4f4a-a444-e98fee6c703e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.692562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.709574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1001/1988] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:20.711049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fea51-d2e2-46bc-b96a-e966b104653e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.715066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fea51-d2e2-46bc-b96a-e966b104653e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.715066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fea51-d2e2-46bc-b96a-e966b104653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.749320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4a6fea51-d2e2-46bc-b96a-e966b104653e None None] MFA Rules not processed for user `fd4364164b99472099cc7abef567bfb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:20.753242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4a6fea51-d2e2-46bc-b96a-e966b104653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:20.761571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:20.800463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 988/1989] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:20.800463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.848968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1002/1990] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:20.849944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fea51-d2e2-46bc-b96a-e966b104653e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:20.861952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fea51-d2e2-46bc-b96a-e966b104653e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.893464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fafa5d-9808-4dcf-9820-9b17b3052c29 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:20.898003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:20.904277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.905534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.906276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.906779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.908180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.912326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:20.944231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:20.945012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:20.945369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:20.945655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:20.946409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:20.948363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.038088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1003/1991] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:21.038928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.046336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:21.049526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 989/1992] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:20 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:21.051065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.054100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:21.060200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b13cae-33e7-4fde-8409-bf3742f1b2c6 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.127259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250623db-cac3-403d-9c97-1089a1cf799b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.132334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.133623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.133923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.134203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] PATH_INFO: `/v3/projects/4e4e985135264724919d8e9b049f4c98` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.134481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.135152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.135461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.135607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4e985135264724919d8e9b049f4c98)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.135743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.136458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.137667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.138452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.275650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1004/1993] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:21 2022] POST /identity/v3/projects => generated 389 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:21.276626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.316047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4e985135264724919d8e9b049f4c98', 'request_id': 'req-7ce76728-2a60-4a19-bba4-cf493120bf8c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.324308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4e985135264724919d8e9b049f4c98', 'request_id': 'req-7ce76728-2a60-4a19-bba4-cf493120bf8c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.344784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd054-15df-4958-8c44-d6564b354c8c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.382667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4e985135264724919d8e9b049f4c98', 'request_id': 'req-7ce76728-2a60-4a19-bba4-cf493120bf8c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.395105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] The token cache is being invalidate because project 4e4e985135264724919d8e9b049f4c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:21.395398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.396079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.397669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 990/1994] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:21 2022] DELETE /identity/v3/projects/4e4e985135264724919d8e9b049f4c98 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:21.398526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.399984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:21.401374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.402191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.402507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.402788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.403561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.405148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.417405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1005/1995] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:21.417575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76728-2a60-4a19-bba4-cf493120bf8c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.425275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.425275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:21.425459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.425459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.425459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.425459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.425726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.425726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.430876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd03855-0c63-4dca-96a6-22f0f24a3916 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.435610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.436266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.436550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.436832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.437561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.439748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.531975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 991/1996] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:21 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:21.532819 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.534682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:21.545134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1006/1997] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:21 2022] POST /identity/v3/users => generated 301 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:21.546147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.546564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db1da0-8bda-4f2d-a9b2-9ce7d1a53bb1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.547938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:21.551385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.552244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.552539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.552873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] PATH_INFO: `/v3/users/c59fdaefafda449295f7103f990e7af2` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.554110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59fdaefafda449295f7103f990e7af2)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.556101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.559896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04fe6-704a-411c-9f18-7b3dc0859d45 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.565400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.566044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.566366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.566649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.568355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.570051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.581848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1007/1998] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:21.582794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.593058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91054-9a59-4ea1-b73d-b29e123fef3d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.597707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.598399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.598673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.598951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.599732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.601294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.611412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1008/1999] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:21.612214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.622118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5752241-8d4c-4041-a0b1-7fbafcc9cc39 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.627349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.627968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.628264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.628542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.629240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.631275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.642645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1009/2000] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:21.643492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.655248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0479-1db7-4797-b34d-96d8219b3d6f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.660349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.661294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.661583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.661865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] PATH_INFO: `/v3/projects/1db8398d2d7a42b4b8ed4acfed0e7b41/users/451e06dd31ef4ea8b2b3090d4757a715/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.676222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db8398d2d7a42b4b8ed4acfed0e7b41, user_id=451e06dd31ef4ea8b2b3090d4757a715, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.678923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.780486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1010/2001] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:21 2022] PUT /identity/v3/projects/1db8398d2d7a42b4b8ed4acfed0e7b41/users/451e06dd31ef4ea8b2b3090d4757a715/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:21.781494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.792644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59fdaefafda449295f7103f990e7af2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.811043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59fdaefafda449295f7103f990e7af2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.862024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26326aad-740c-4b3f-8f1a-ce43493e5fcf admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.866919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.867588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.867871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.868146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.868977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.870647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.884621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1011/2002] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:21.884621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:21.885597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59fdaefafda449295f7103f990e7af2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.894547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fa05a-1500-48b0-a90e-99be826fd7e4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:21.900112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:21.901096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.901279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.901534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] PATH_INFO: `/v3/projects/d986930d408d410b8f5a573cf72f8e55/users/b5966011b8e44f6ca3bf472538fc8881/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.902413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59fdaefafda449295f7103f990e7af2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.903550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-050825c4-5ae8-439b-93bc-355ef15a9b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59fdaefafda449295f7103f990e7af2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:21.920764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 992/2003] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:21 2022] DELETE /identity/v3/users/c59fdaefafda449295f7103f990e7af2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:21.923379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:21.923678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:21.924495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:21.928060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d986930d408d410b8f5a573cf72f8e55, user_id=b5966011b8e44f6ca3bf472538fc8881, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:21.931389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:21.960132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] MFA Rules not processed for user `451e06dd31ef4ea8b2b3090d4757a715`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:21.960132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.012316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1012/2004] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:21 2022] PUT /identity/v3/projects/d986930d408d410b8f5a573cf72f8e55/users/b5966011b8e44f6ca3bf472538fc8881/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:22.013413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.020300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.027811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 993/2005] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:22.028659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.029899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.087176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9db26-188a-4147-a16b-9f68b3b05454 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.091914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.092841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.093078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.093359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] PATH_INFO: `/v3/projects/a060a8bd61f141a99f10fea1c69c2311/users/b15af24b44364fdf9c24abf168a7cd83/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.096756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ed52c-c4ef-4a86-82e3-9d5caae395cb None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.103871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.104887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.105357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.105776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.106728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.108526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.110041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a060a8bd61f141a99f10fea1c69c2311, user_id=b15af24b44364fdf9c24abf168a7cd83, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.113365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.120669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:22.121469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 994/2006] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:22.122352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.127511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.142262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0ab3-4a1a-44ad-92fe-42b1a04edfd6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.148626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0695f49-890e-462c-9fc8-9f333ebd2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.149329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695f49-890e-462c-9fc8-9f333ebd2778 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.149609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695f49-890e-462c-9fc8-9f333ebd2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.149889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695f49-890e-462c-9fc8-9f333ebd2778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.153549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0695f49-890e-462c-9fc8-9f333ebd2778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.153549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0695f49-890e-462c-9fc8-9f333ebd2778 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.185459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1013/2007] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:22 2022] PUT /identity/v3/projects/a060a8bd61f141a99f10fea1c69c2311/users/b15af24b44364fdf9c24abf168a7cd83/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:22.201005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.262435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa0556-bae6-4b9d-bef7-1a0ecc7b6790 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.270959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 995/2008] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:22 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:22.272038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.272955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.273250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.273528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] PATH_INFO: `/v3/projects/d986930d408d410b8f5a573cf72f8e55/users/b5966011b8e44f6ca3bf472538fc8881/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.275284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932cd3f-5c6e-4279-8986-ffaa341ac61c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.275523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932cd3f-5c6e-4279-8986-ffaa341ac61c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.275810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932cd3f-5c6e-4279-8986-ffaa341ac61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.280423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d986930d408d410b8f5a573cf72f8e55, user_id=b5966011b8e44f6ca3bf472538fc8881, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.280423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.292860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1014/2009] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:22 2022] PUT /identity/v3/projects/d986930d408d410b8f5a573cf72f8e55/users/b5966011b8e44f6ca3bf472538fc8881/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:22.293697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.319690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c932cd3f-5c6e-4279-8986-ffaa341ac61c None None] MFA Rules not processed for user `b15af24b44364fdf9c24abf168a7cd83`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:22.320831 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c932cd3f-5c6e-4279-8986-ffaa341ac61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.360034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc5c79-8549-4f38-b1f6-6f32fe04a923 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.365685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.366387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.366681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.366959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.367644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.369571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.391817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 996/2010] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:22.393239 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.393534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.393817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.409751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:22.420245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] MFA Rules not processed for user `b5966011b8e44f6ca3bf472538fc8881`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:22.421455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.494396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1015/2011] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:22 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:22.495834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.498150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.506265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 997/2012] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:22.507221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.508829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.527700 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e210e-d6cd-42e1-9a5e-47f58dda1700 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.532927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.534036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.534371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.534639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] PATH_INFO: `/v3/projects/c4ae7c9bb6f84565b8998a44962525b9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.535877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ae7c9bb6f84565b8998a44962525b9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.537864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.580027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57f10-776b-4e87-bf0d-8da0d24883af admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.585739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.586424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.586736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.587303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.596242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.597823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.606498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1016/2013] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:22.607274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.617181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350b40b-ef26-4b40-8e47-1d506d94a36a service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.622048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.622778 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.623042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.623315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.624019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.625558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.637306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1017/2014] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:22.638322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.640621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.661996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ae7c9bb6f84565b8998a44962525b9', 'request_id': 'req-5aad8e01-62b7-46b6-b711-1438dd296e27'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:22.667570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ae7c9bb6f84565b8998a44962525b9', 'request_id': 'req-5aad8e01-62b7-46b6-b711-1438dd296e27'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:22.702419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572f0c-8fcd-4583-80a9-a5a44dc7b78d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.727343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ae7c9bb6f84565b8998a44962525b9', 'request_id': 'req-5aad8e01-62b7-46b6-b711-1438dd296e27'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:22.739249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] The token cache is being invalidate because project c4ae7c9bb6f84565b8998a44962525b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:22.739543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:22.740304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:22.745501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 998/2015] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:22 2022] DELETE /identity/v3/projects/c4ae7c9bb6f84565b8998a44962525b9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:22.745501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.745501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.754958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d89fb-382c-4020-862c-f5e8fad8c573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.755782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d89fb-382c-4020-862c-f5e8fad8c573 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.756067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d89fb-382c-4020-862c-f5e8fad8c573 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.756345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d89fb-382c-4020-862c-f5e8fad8c573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.758182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-527d89fb-382c-4020-862c-f5e8fad8c573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.811756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8e01-62b7-46b6-b711-1438dd296e27 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.816584 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.817582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.817917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.818358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] PATH_INFO: `/v3/projects/c4a3d1efca2040b786312345e9fd1fab/users/b82f5986ff2746dfaecf3a55d8802a7e/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.826080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d89fb-382c-4020-862c-f5e8fad8c573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.826080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d89fb-382c-4020-862c-f5e8fad8c573 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.835752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3d1efca2040b786312345e9fd1fab, user_id=b82f5986ff2746dfaecf3a55d8802a7e, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.836582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1018/2016] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:22.838043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de015-c19c-411b-8706-f55738c553c9 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.838375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de015-c19c-411b-8706-f55738c553c9 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.838651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.838776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de015-c19c-411b-8706-f55738c553c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.861130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b62de015-c19c-411b-8706-f55738c553c9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:22.862428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b62de015-c19c-411b-8706-f55738c553c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.871274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1019/2017] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:22.879040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349de8a-cfb8-43c6-98ba-353818248803 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.879331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349de8a-cfb8-43c6-98ba-353818248803 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.879617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349de8a-cfb8-43c6-98ba-353818248803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.908725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7349de8a-cfb8-43c6-98ba-353818248803 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:22.910070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7349de8a-cfb8-43c6-98ba-353818248803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:22.917976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1020/2018] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:22.921834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349de8a-cfb8-43c6-98ba-353818248803 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.931245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349de8a-cfb8-43c6-98ba-353818248803 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:22.936475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:22.937251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:22.937537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:22.937811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:22.938593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:22.940258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:22.940567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:22.942731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 999/2019] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:22 2022] PUT /identity/v3/projects/c4a3d1efca2040b786312345e9fd1fab/users/b82f5986ff2746dfaecf3a55d8802a7e/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:22.943693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.953497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1021/2020] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:45:22.958293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:22.974790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cf1c7-d55c-4bd5-be7d-b0f803f6ba01 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:23.030078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced8b7-c422-483d-9ba0-398d4273538e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:23.041585 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:23.042297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:23.042920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:23.043209 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:23.043946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:23.045575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:23.066522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1000/2021] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:23.067518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:23.074086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc96761-f60f-4091-b262-96f01d9607f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:23.074942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96761-f60f-4091-b262-96f01d9607f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:23.075240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96761-f60f-4091-b262-96f01d9607f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:23.075509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96761-f60f-4091-b262-96f01d9607f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:23.076201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc96761-f60f-4091-b262-96f01d9607f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:23.078138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc96761-f60f-4091-b262-96f01d9607f6 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:23.085191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dea813-6153-480b-bf40-bfd9dd586e88 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:23.093971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:23.093971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:23.093971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:23.094204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] PATH_INFO: `/v3/projects/c4a3d1efca2040b786312345e9fd1fab/users/b82f5986ff2746dfaecf3a55d8802a7e/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:23.097870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3d1efca2040b786312345e9fd1fab, user_id=b82f5986ff2746dfaecf3a55d8802a7e, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:23.101909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:23.113842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1001/2022] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:23 2022] PUT /identity/v3/projects/c4a3d1efca2040b786312345e9fd1fab/users/b82f5986ff2746dfaecf3a55d8802a7e/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:23.119192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:23.120837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:23.196203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e0648-9112-41dc-8759-1ffda4d7c3f2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:23.201312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:23.202330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:23.202676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:23.202995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] PATH_INFO: `/v3/users/fd4364164b99472099cc7abef567bfb5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:23.204800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4364164b99472099cc7abef567bfb5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:23.206778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:23.487982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1022/2023] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:22 2022] POST /identity/v3/projects => generated 375 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:23.487982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d073-0c8e-4bf7-8d73-afcfb4cdc20a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:23.487982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d073-0c8e-4bf7-8d73-afcfb4cdc20a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:23.487982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d073-0c8e-4bf7-8d73-afcfb4cdc20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:23.513472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8564d073-0c8e-4bf7-8d73-afcfb4cdc20a None None] MFA Rules not processed for user `b82f5986ff2746dfaecf3a55d8802a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:23.517269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8564d073-0c8e-4bf7-8d73-afcfb4cdc20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:23.585149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1023/2024] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:23.600312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564d073-0c8e-4bf7-8d73-afcfb4cdc20a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:23.657069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564d073-0c8e-4bf7-8d73-afcfb4cdc20a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:23.657069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:23.657069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:23.657069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:23.657969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:23.658770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:23.660691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:23.820558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4364164b99472099cc7abef567bfb5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:23.827117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4364164b99472099cc7abef567bfb5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:23.848395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1024/2025] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:23 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:23.851958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:23.851958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:23.898783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4364164b99472099cc7abef567bfb5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:23.912394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4364164b99472099cc7abef567bfb5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:23.913110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4364164b99472099cc7abef567bfb5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:23.916238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e5c7-f782-4403-a69d-52294e6c1790 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:23.919605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1002/2026] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:23 2022] DELETE /identity/v3/users/fd4364164b99472099cc7abef567bfb5 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:23.926057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e07a5-2050-4357-b5d7-8ab44c9b3a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:23.926057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e07a5-2050-4357-b5d7-8ab44c9b3a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:23.926057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e07a5-2050-4357-b5d7-8ab44c9b3a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:23.926057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e07a5-2050-4357-b5d7-8ab44c9b3a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:23.926562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:23.926562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:23.929169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-de8e07a5-2050-4357-b5d7-8ab44c9b3a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:23.992168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97e69-9b53-463b-8f58-dbe614449ad1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:23.994685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e07a5-2050-4357-b5d7-8ab44c9b3a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:24.001620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:24.002798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.003122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e07a5-2050-4357-b5d7-8ab44c9b3a08 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:24.003280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.003755 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.004608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:24.006415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:24.013735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1025/2027] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:24.015321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.015742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.016027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.022008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1003/2028] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:24.023190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:24.024997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:24.035443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00bf6-7d13-456f-a142-fbe51f6b7404 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:24.037352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:24.038602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:24.041312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:24.042010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.042298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.042734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.043567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:24.045350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:24.047545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1026/2029] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:24.056984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:24.059271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:24.062850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1004/2030] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:24.068600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:24.080018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d74d2-0325-4b6f-913f-d5ea67449169 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:24.089913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f73db2-ca9c-40f8-b6f8-066f6e9041e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:24.091105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f73db2-ca9c-40f8-b6f8-066f6e9041e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.092948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f73db2-ca9c-40f8-b6f8-066f6e9041e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.093236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f73db2-ca9c-40f8-b6f8-066f6e9041e7 admin admin] PATH_INFO: `/v3/projects/170d077fb35b43ff89314f9c5a81ac0a/users/8d24e8a946194d3d8646fd0cd919e12e/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.112219 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f73db2-ca9c-40f8-b6f8-066f6e9041e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170d077fb35b43ff89314f9c5a81ac0a, user_id=8d24e8a946194d3d8646fd0cd919e12e, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:24.115464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f73db2-ca9c-40f8-b6f8-066f6e9041e7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:24.144629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907b965-8eec-4067-a94a-a1375c27d4fb None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:24.148520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:24.149739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.149739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.149739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.159074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:24.160582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:24.167702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1005/2031] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:24 2022] PUT /identity/v3/projects/170d077fb35b43ff89314f9c5a81ac0a/users/8d24e8a946194d3d8646fd0cd919e12e/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:24.175779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1027/2032] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:24.178356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.178653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.178962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.210878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] MFA Rules not processed for user `8d24e8a946194d3d8646fd0cd919e12e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:24.212224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:24.263803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:24.299235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1006/2033] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:24.310302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:24.311818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:24.372728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8c32-af84-4843-a737-933594e202f0 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:24.422452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:24.423844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.424132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.424476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.433706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:24.435265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:24.445204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1028/2034] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:24.737498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:24.739094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:24.832378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c289cec-d6bf-4369-b67b-b9bfd3cfdf4b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:24.839863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:24.840779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:24.841060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:24.841346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] PATH_INFO: `/v3/projects/632eb11fd07e441599711e5da2cb9b44` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:24.846636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632eb11fd07e441599711e5da2cb9b44)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:24.846636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:25.025357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632eb11fd07e441599711e5da2cb9b44', 'request_id': 'req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.030632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632eb11fd07e441599711e5da2cb9b44', 'request_id': 'req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.116208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632eb11fd07e441599711e5da2cb9b44', 'request_id': 'req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.128139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] The token cache is being invalidate because project 632eb11fd07e441599711e5da2cb9b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:25.128459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.129121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.130716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1007/2035] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:24 2022] DELETE /identity/v3/projects/632eb11fd07e441599711e5da2cb9b44 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:25.134704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:25.145904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe65412-9d27-4946-94d5-b65b158f3c85 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:25.217808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:25.218732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:25.219034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:25.219296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] PATH_INFO: `/v3/users/b5966011b8e44f6ca3bf472538fc8881` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:25.220517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5966011b8e44f6ca3bf472538fc8881)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:25.222469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:25.537290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5966011b8e44f6ca3bf472538fc8881'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.544886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5966011b8e44f6ca3bf472538fc8881'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.545607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5966011b8e44f6ca3bf472538fc8881'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.546475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5966011b8e44f6ca3bf472538fc8881'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.670065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-860c31d7-32ca-4aba-9172-b6783cb81703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5966011b8e44f6ca3bf472538fc8881'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:25.692219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1029/2036] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:25 2022] DELETE /identity/v3/users/b5966011b8e44f6ca3bf472538fc8881 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:25.960708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:26.140300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:26.142563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:26.170557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ca7a-4d74-433f-9a1f-785ffc2e5596 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:26.226513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:26.227364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:26.227648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:26.227927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] PATH_INFO: `/v3/projects/d986930d408d410b8f5a573cf72f8e55` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:26.229240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d986930d408d410b8f5a573cf72f8e55)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:26.231367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:26.356394 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:26.400663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd986930d408d410b8f5a573cf72f8e55', 'request_id': 'req-8649e933-4d5b-45b5-9b1a-afa9f1b04254'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:26.405835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd986930d408d410b8f5a573cf72f8e55', 'request_id': 'req-8649e933-4d5b-45b5-9b1a-afa9f1b04254'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:26.570946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd986930d408d410b8f5a573cf72f8e55', 'request_id': 'req-8649e933-4d5b-45b5-9b1a-afa9f1b04254'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:26.582388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] The token cache is being invalidate because project d986930d408d410b8f5a573cf72f8e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:26.582791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:26.583491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8649e933-4d5b-45b5-9b1a-afa9f1b04254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:26.585108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1008/2037] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:26 2022] DELETE /identity/v3/projects/d986930d408d410b8f5a573cf72f8e55 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:26.590113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df764d-9c72-40dc-8c14-5f358d5c211a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:26.590251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df764d-9c72-40dc-8c14-5f358d5c211a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:26.590518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df764d-9c72-40dc-8c14-5f358d5c211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:26.609993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-03df764d-9c72-40dc-8c14-5f358d5c211a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:26.611310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-03df764d-9c72-40dc-8c14-5f358d5c211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:26.673290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1030/2038] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:26.685672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec559f-66c0-488e-8df7-94721d230c63 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:26.686351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec559f-66c0-488e-8df7-94721d230c63 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:26.686814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec559f-66c0-488e-8df7-94721d230c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:26.710423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-89ec559f-66c0-488e-8df7-94721d230c63 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:26.714747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-89ec559f-66c0-488e-8df7-94721d230c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:26.721250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1009/2039] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:26.725663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df764d-9c72-40dc-8c14-5f358d5c211a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:26.738604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df764d-9c72-40dc-8c14-5f358d5c211a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:26.749609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:26.749609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:26.749609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:26.749609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:26.749969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:26.749969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:26.749969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:26.762316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1031/2040] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:26.766853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec559f-66c0-488e-8df7-94721d230c63 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:26.777478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec559f-66c0-488e-8df7-94721d230c63 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:26.782472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:26.783137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:26.783716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:26.784282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:26.785140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:26.787103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:26.892602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1010/2041] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:26 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:26.892803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:26.901384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bc1a3-9f51-4a44-8111-dbc1cb4b4d33 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:26.964254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:26.964926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:26.965211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:26.965527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:26.966251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:26.970500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.053619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.055335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:27.056969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1032/2042] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:26 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:27.057845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.068385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb2c5-28ef-40e6-a9eb-179da7fc7255 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.069245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc74c-9c8c-4446-b5c3-2df8f4c1c2a4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.073183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.073839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.074203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.079404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.079520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.079612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.079691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.079691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.079691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] PATH_INFO: `/v3/users/451e06dd31ef4ea8b2b3090d4757a715` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.079883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.079958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451e06dd31ef4ea8b2b3090d4757a715)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.079958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.091242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1033/2043] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:27.095295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.105147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1d50-e742-45b2-9f0f-2a4783d82f09 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.110016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.110706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.110989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.111286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.112588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.114342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.129761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1034/2044] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:27.130769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.133341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:27.140478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26bcdb-ceeb-452b-8de3-322b111b13ff admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.145446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e1b14-04b7-49ae-a39e-777276ebec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.146361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1b14-04b7-49ae-a39e-777276ebec19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.146645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1b14-04b7-49ae-a39e-777276ebec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.146923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1b14-04b7-49ae-a39e-777276ebec19 admin admin] PATH_INFO: `/v3/projects/3b5898a394dc43a385f491d50af83575/users/29bd78642cc04567919020ec9e718543/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.161074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e1b14-04b7-49ae-a39e-777276ebec19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5898a394dc43a385f491d50af83575, user_id=29bd78642cc04567919020ec9e718543, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.163736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e1b14-04b7-49ae-a39e-777276ebec19 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.249990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1035/2045] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:27 2022] PUT /identity/v3/projects/3b5898a394dc43a385f491d50af83575/users/29bd78642cc04567919020ec9e718543/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:27.261638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483d77-d422-4f3f-a149-d50591633956 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.261925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483d77-d422-4f3f-a149-d50591633956 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.262239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483d77-d422-4f3f-a149-d50591633956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.290839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6b483d77-d422-4f3f-a149-d50591633956 None None] MFA Rules not processed for user `29bd78642cc04567919020ec9e718543`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:27.292284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6b483d77-d422-4f3f-a149-d50591633956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:27.359375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1036/2046] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:27.368793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483d77-d422-4f3f-a149-d50591633956 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.420498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451e06dd31ef4ea8b2b3090d4757a715'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:27.428883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451e06dd31ef4ea8b2b3090d4757a715'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:27.432465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483d77-d422-4f3f-a149-d50591633956 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.437376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.438039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.438364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.438659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.439357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.441917 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.499387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451e06dd31ef4ea8b2b3090d4757a715'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:27.511669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451e06dd31ef4ea8b2b3090d4757a715'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:27.512318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b7ad18af-c419-4ae6-9451-604cfd44ac33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451e06dd31ef4ea8b2b3090d4757a715'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:27.519187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1011/2047] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:27 2022] DELETE /identity/v3/users/451e06dd31ef4ea8b2b3090d4757a715 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:27.523709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.524006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.524289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.542240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:27.543445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:27.562571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1037/2048] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:27 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:27.566936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.568723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:27.611688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1012/2049] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:27.622828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.624228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:27.643055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b919e1-46d8-4902-9e6f-0fd9e47d9ca3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.647827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.648500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.648980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.649261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.650093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.652457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.685309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5568c5-10eb-4b54-b8c1-c13dade53c21 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.727740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:27.734890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.735901 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.736185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.736463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.739467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1038/2050] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:27 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:27.740378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.750512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.750512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.750741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0b25f-9366-4132-9f6d-be678b53ec55 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.754859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.755497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.755782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.756077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.756784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.758403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.758564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1013/2051] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:27.768606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1039/2052] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:27.772800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.783207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14c66b-d25b-4f62-a2ee-285f3c8f6a30 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.789024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.790120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.790445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.790730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] PATH_INFO: `/v3/projects/8085c1929dfa44f49f7439a53eaf829a/users/7837b9ea9b744a3aa121441993d69e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.815819 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8085c1929dfa44f49f7439a53eaf829a, user_id=7837b9ea9b744a3aa121441993d69e30, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.821825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:27.913439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:27.917672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1014/2053] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:27 2022] PUT /identity/v3/projects/8085c1929dfa44f49f7439a53eaf829a/users/7837b9ea9b744a3aa121441993d69e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:27.921896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:27.932670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722010bb-f22f-4636-882f-b85c4855ebe4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:27.995171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bb8da-6b36-4eec-9700-c303417c5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:27.996208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb8da-6b36-4eec-9700-c303417c5abf admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:27.996477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb8da-6b36-4eec-9700-c303417c5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:27.996811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb8da-6b36-4eec-9700-c303417c5abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:27.997543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bb8da-6b36-4eec-9700-c303417c5abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:27.999210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bb8da-6b36-4eec-9700-c303417c5abf admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:28.011898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1040/2054] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:28.021444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:28.035382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd9a0f-46a6-41aa-907c-4b9835a82dbc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:28.041228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:28.042340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:28.045586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:28.045586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] PATH_INFO: `/v3/projects/8085c1929dfa44f49f7439a53eaf829a/users/7837b9ea9b744a3aa121441993d69e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:28.045586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8085c1929dfa44f49f7439a53eaf829a, user_id=7837b9ea9b744a3aa121441993d69e30, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:28.049406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:28.062250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1015/2055] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:28 2022] PUT /identity/v3/projects/8085c1929dfa44f49f7439a53eaf829a/users/7837b9ea9b744a3aa121441993d69e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:28.079364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:28.079687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:28.080032 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:28.110568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] MFA Rules not processed for user `7837b9ea9b744a3aa121441993d69e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:28.111819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:28.193786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1041/2056] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:28.204603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:28.206927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:28.265339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3341347-7214-40ce-826c-3b29db8c1266 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:28.270232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:28.270995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:28.271284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:28.271559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:28.281632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:28.283122 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:28.293815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1016/2057] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:28.324355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:28.325915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:28.410853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e061c-5c40-439f-860c-a9f667fa5906 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:28.420096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:28.420977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:28.421257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:28.421530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] PATH_INFO: `/v3/projects/1db8398d2d7a42b4b8ed4acfed0e7b41` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:28.422808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db8398d2d7a42b4b8ed4acfed0e7b41)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:28.427680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:28.542885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db8398d2d7a42b4b8ed4acfed0e7b41', 'request_id': 'req-aaad48ff-de88-4988-af4a-05975ef82706'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:28.548417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db8398d2d7a42b4b8ed4acfed0e7b41', 'request_id': 'req-aaad48ff-de88-4988-af4a-05975ef82706'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:28.630056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db8398d2d7a42b4b8ed4acfed0e7b41', 'request_id': 'req-aaad48ff-de88-4988-af4a-05975ef82706'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:28.642757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] The token cache is being invalidate because project 1db8398d2d7a42b4b8ed4acfed0e7b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:28.643128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:28.643767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:28.645480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1042/2058] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:28 2022] DELETE /identity/v3/projects/1db8398d2d7a42b4b8ed4acfed0e7b41 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:28.649399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:28.660390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f420b1-3b17-4fd2-bc94-f7e5252bfb1c service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:28.722692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:28.723571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:28.723855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:28.724133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] PATH_INFO: `/v3/users/b82f5986ff2746dfaecf3a55d8802a7e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:28.725319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82f5986ff2746dfaecf3a55d8802a7e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:28.727287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:28.881163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:28.882654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:28.895157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad48ff-de88-4988-af4a-05975ef82706 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:28.899868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:28.900960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:28.901178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:28.901254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] PATH_INFO: `/v3/users/8d24e8a946194d3d8646fd0cd919e12e` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:28.902467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d24e8a946194d3d8646fd0cd919e12e)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:28.904468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:28.941770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82f5986ff2746dfaecf3a55d8802a7e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:28.949414 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82f5986ff2746dfaecf3a55d8802a7e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.053003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82f5986ff2746dfaecf3a55d8802a7e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.065988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82f5986ff2746dfaecf3a55d8802a7e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.066750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82f5986ff2746dfaecf3a55d8802a7e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.072885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1017/2059] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:28 2022] DELETE /identity/v3/users/b82f5986ff2746dfaecf3a55d8802a7e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:29.073741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:29.075089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:29.147348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0625997-493e-4070-b184-2b85acd47ee6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:29.153455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:29.154373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:29.154744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:29.154955 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] PATH_INFO: `/v3/users/29bd78642cc04567919020ec9e718543` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:29.156170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bd78642cc04567919020ec9e718543)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:29.158120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:29.189824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d24e8a946194d3d8646fd0cd919e12e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.196723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d24e8a946194d3d8646fd0cd919e12e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.197379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d24e8a946194d3d8646fd0cd919e12e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.197969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d24e8a946194d3d8646fd0cd919e12e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.294245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-949b12cb-3f17-4046-aa25-ca8ae40cad38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d24e8a946194d3d8646fd0cd919e12e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.316961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1043/2060] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:28 2022] DELETE /identity/v3/users/8d24e8a946194d3d8646fd0cd919e12e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:29.321882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:29.322906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:29.322906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:29.343285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:29.347742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:29.416631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1044/2061] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:29.425591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:29.428830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:29.430332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bd78642cc04567919020ec9e718543'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.440879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bd78642cc04567919020ec9e718543'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.462701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:29.501112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f810-9e5a-4b42-9fae-b72d461785d2 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:29.505000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:29.505662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:29.505947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:29.506240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:29.519759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:29.521258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:29.530677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1045/2062] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:29.531457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:29.532785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:29.538544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bd78642cc04567919020ec9e718543'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.546328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985ca2-77ce-4934-9cc5-526202ea5688 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:29.558090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bd78642cc04567919020ec9e718543'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.558090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bd78642cc04567919020ec9e718543'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.560339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:29.561647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:29.562113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:29.562569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] PATH_INFO: `/v3/users/b15af24b44364fdf9c24abf168a7cd83` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:29.563964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15af24b44364fdf9c24abf168a7cd83)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:29.565818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1018/2063] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:29 2022] DELETE /identity/v3/users/29bd78642cc04567919020ec9e718543 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:29.567262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:29.569964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:29.573781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:29.645832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7ea3a-3784-4057-8fe2-ca84333706eb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:29.650505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:29.651422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:29.651708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:29.651992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] PATH_INFO: `/v3/projects/c4a3d1efca2040b786312345e9fd1fab` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:29.653177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a3d1efca2040b786312345e9fd1fab)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:29.655141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:29.818895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a3d1efca2040b786312345e9fd1fab', 'request_id': 'req-c6850672-5693-4efe-a217-a033d7c17165'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.822142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15af24b44364fdf9c24abf168a7cd83'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.825199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a3d1efca2040b786312345e9fd1fab', 'request_id': 'req-c6850672-5693-4efe-a217-a033d7c17165'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.829878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15af24b44364fdf9c24abf168a7cd83'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.831241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15af24b44364fdf9c24abf168a7cd83'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.831912 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15af24b44364fdf9c24abf168a7cd83'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.859027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:29.921364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a3d1efca2040b786312345e9fd1fab', 'request_id': 'req-c6850672-5693-4efe-a217-a033d7c17165'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.934594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] The token cache is being invalidate because project c4a3d1efca2040b786312345e9fd1fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:29.934886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.935565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c6850672-5693-4efe-a217-a033d7c17165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:29.937208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1019/2064] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:29 2022] DELETE /identity/v3/projects/c4a3d1efca2040b786312345e9fd1fab => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:29.938474 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c021f-d798-4e67-9305-8615a7c21189 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:29.938762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c021f-d798-4e67-9305-8615a7c21189 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:29.939042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c021f-d798-4e67-9305-8615a7c21189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:29.956917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ca8c021f-d798-4e67-9305-8615a7c21189 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:29.958913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ca8c021f-d798-4e67-9305-8615a7c21189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.016475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1020/2065] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:30.018629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b619f2-6974-4e05-9c3a-5a5ee80a2a7b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.018973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15af24b44364fdf9c24abf168a7cd83'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.019099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b619f2-6974-4e05-9c3a-5a5ee80a2a7b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.019364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b619f2-6974-4e05-9c3a-5a5ee80a2a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.037270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1046/2066] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:29 2022] DELETE /identity/v3/users/b15af24b44364fdf9c24abf168a7cd83 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:30.038095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.038514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-94b619f2-6974-4e05-9c3a-5a5ee80a2a7b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:30.039443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.039762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-94b619f2-6974-4e05-9c3a-5a5ee80a2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.108451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1021/2067] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:30.109927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe620-71e0-4a84-af06-967a0452594a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.110240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe620-71e0-4a84-af06-967a0452594a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.110538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe620-71e0-4a84-af06-967a0452594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.114451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33cd3b-db78-41e0-8890-1c136759daaa admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.118225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.119405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.119693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.119973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.130347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.131797 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.134854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ef1fe620-71e0-4a84-af06-967a0452594a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:30.136428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ef1fe620-71e0-4a84-af06-967a0452594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.143655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1047/2068] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:30.145315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.146977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.147359 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1022/2069] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:30.162751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.162751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.162751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.163136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9907-59cc-4d24-98a1-a4e3bce168b4 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.171447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.173952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.173952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.173952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] PATH_INFO: `/v3/projects/170d077fb35b43ff89314f9c5a81ac0a` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.174826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170d077fb35b43ff89314f9c5a81ac0a)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.176605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.179483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:30.180776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.191179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1023/2070] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:30.192034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.193305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.219195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2a3f4-a15a-4b92-bc65-31a0bc56d506 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.225749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.226713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.226925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.227211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.238319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.239931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.255403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1024/2071] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:30.256820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.267344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fdda9-dc60-4e9a-b188-bb94cf84974b service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.273230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.274303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.274596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.277071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.277071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:30.282562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.284672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.297424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1025/2072] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:30.302547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.313650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04fb02-5389-4ab4-ba93-26f5cc0943be admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.321051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170d077fb35b43ff89314f9c5a81ac0a', 'request_id': 'req-cd380808-ba21-4739-87d9-e8a9fd629839'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.334360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170d077fb35b43ff89314f9c5a81ac0a', 'request_id': 'req-cd380808-ba21-4739-87d9-e8a9fd629839'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.398309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.399647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.405853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.406480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.407511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.410348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.412829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170d077fb35b43ff89314f9c5a81ac0a', 'request_id': 'req-cd380808-ba21-4739-87d9-e8a9fd629839'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.439321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] The token cache is being invalidate because project 170d077fb35b43ff89314f9c5a81ac0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:30.440457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.441516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd380808-ba21-4739-87d9-e8a9fd629839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.442918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1048/2073] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:30 2022] DELETE /identity/v3/projects/170d077fb35b43ff89314f9c5a81ac0a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:30.448251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f9e67-7240-40e3-b44b-41c3585ce439 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.453919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f9e67-7240-40e3-b44b-41c3585ce439 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.453919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f9e67-7240-40e3-b44b-41c3585ce439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.472926 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8d7f9e67-7240-40e3-b44b-41c3585ce439 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:30.474243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8d7f9e67-7240-40e3-b44b-41c3585ce439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.482813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1049/2074] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:30.492703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.492992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.493273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.515883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1026/2075] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:30.519615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:30.521232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.521571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.526992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.604381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974679-df47-472f-a357-741777d7d6e8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.610865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1050/2076] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:30.612834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.613625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.613979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.614394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.615246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.615534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.616918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.617379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.632333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2746b-b8fb-4c5e-8190-3bdfd129f75c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.638018 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.639134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.640430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.640806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] PATH_INFO: `/v3/projects/3b5898a394dc43a385f491d50af83575` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.642364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5898a394dc43a385f491d50af83575)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.644432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.700444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1027/2077] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:30.700444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.708591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a5626-e9c9-49af-91e7-a3aa99c85e23 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.713748 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.714754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.716294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:30.716779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.717089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.718012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:30.718476 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.726483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.740266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1028/2078] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:30.741263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.750541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06eff4-2027-46db-ac64-ca0516baefbd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.755186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.755810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.756092 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.756364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.757058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.758661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.771262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1029/2079] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:30.771262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.780988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1feb58-8087-432b-9e54-e0e7b60df35f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.793009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5898a394dc43a385f491d50af83575', 'request_id': 'req-f25be8df-a1b2-4b18-ae5c-1b2663190c48'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.806570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5898a394dc43a385f491d50af83575', 'request_id': 'req-f25be8df-a1b2-4b18-ae5c-1b2663190c48'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.858501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.859269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.859699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.859837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.860554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.862825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.875885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5898a394dc43a385f491d50af83575', 'request_id': 'req-f25be8df-a1b2-4b18-ae5c-1b2663190c48'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.887793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] The token cache is being invalidate because project 3b5898a394dc43a385f491d50af83575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:30.888078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.888713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:30.890307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1051/2080] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:30 2022] DELETE /identity/v3/projects/3b5898a394dc43a385f491d50af83575 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:30.891071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.892347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.905459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be8df-a1b2-4b18-ae5c-1b2663190c48 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.911204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.911857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.912174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.912455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.913213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.914851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.924626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1052/2081] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:30.925573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.927189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:30.940488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61041f0-debb-4efb-b2d2-10e85a35020f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:30.945494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:30.946424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:30.946711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:30.946991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] PATH_INFO: `/v3/projects/a060a8bd61f141a99f10fea1c69c2311` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:30.948237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a060a8bd61f141a99f10fea1c69c2311)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:30.950243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:30.980404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1030/2082] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:30 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:30.981241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:30.983480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.044985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470014b-a341-482d-a8e7-3a15c6c4e208 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.049997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.050961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.051253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.051537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] PATH_INFO: `/v3/users/7837b9ea9b744a3aa121441993d69e30` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.052754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7837b9ea9b744a3aa121441993d69e30)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.055035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.066456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a060a8bd61f141a99f10fea1c69c2311', 'request_id': 'req-b4911fb2-dfbe-4786-953f-09c7f22eab8c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.071465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:31.073659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a060a8bd61f141a99f10fea1c69c2311', 'request_id': 'req-b4911fb2-dfbe-4786-953f-09c7f22eab8c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.184274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a060a8bd61f141a99f10fea1c69c2311', 'request_id': 'req-b4911fb2-dfbe-4786-953f-09c7f22eab8c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.197482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] The token cache is being invalidate because project a060a8bd61f141a99f10fea1c69c2311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:31.197775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.198456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.200080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1053/2083] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:30 2022] DELETE /identity/v3/projects/a060a8bd61f141a99f10fea1c69c2311 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:31.200828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.202129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.266253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911fb2-dfbe-4786-953f-09c7f22eab8c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.271680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.272570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.272861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.273140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] PATH_INFO: `/v3/projects/ca003fa93ecc405390596f761c76c5ab/users/fc394c9ad9ed4b09bebc24ad11518d28/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.287656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca003fa93ecc405390596f761c76c5ab, user_id=fc394c9ad9ed4b09bebc24ad11518d28, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.290368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.307211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7837b9ea9b744a3aa121441993d69e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.315491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7837b9ea9b744a3aa121441993d69e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.396878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1054/2084] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:31 2022] PUT /identity/v3/projects/ca003fa93ecc405390596f761c76c5ab/users/fc394c9ad9ed4b09bebc24ad11518d28/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:31.397835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.399542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.463176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab6b4e-8751-4d52-809d-4242abf038c2 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.468522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52c89-aa33-45de-9d3b-e26a6e985d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.469961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52c89-aa33-45de-9d3b-e26a6e985d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.470277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52c89-aa33-45de-9d3b-e26a6e985d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.470564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52c89-aa33-45de-9d3b-e26a6e985d8b admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.470703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7837b9ea9b744a3aa121441993d69e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.471258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52c89-aa33-45de-9d3b-e26a6e985d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.473260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52c89-aa33-45de-9d3b-e26a6e985d8b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.484143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7837b9ea9b744a3aa121441993d69e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.484934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-82e73d26-1812-4f63-aad1-bd6529531817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7837b9ea9b744a3aa121441993d69e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:31.491430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1031/2085] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:30 2022] DELETE /identity/v3/users/7837b9ea9b744a3aa121441993d69e30 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:31.495830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.496235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.496571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.514935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:31.516137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.542177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1055/2086] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:31 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:31.542879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cd5fa-59af-4796-9416-0dd720b520ea None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.543278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cd5fa-59af-4796-9416-0dd720b520ea None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.543623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cd5fa-59af-4796-9416-0dd720b520ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.577074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-3b8cd5fa-59af-4796-9416-0dd720b520ea None None] MFA Rules not processed for user `fc394c9ad9ed4b09bebc24ad11518d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:31.578637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3b8cd5fa-59af-4796-9416-0dd720b520ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.597051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1032/2087] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:31.597051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.602474 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.615879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff56742-94c5-48f6-b10a-2d5fe0d807b4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.621390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6741f68-af8b-4d97-a99a-ec9c8b57729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.622201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6741f68-af8b-4d97-a99a-ec9c8b57729a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.624145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6741f68-af8b-4d97-a99a-ec9c8b57729a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.624145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6741f68-af8b-4d97-a99a-ec9c8b57729a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.624145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6741f68-af8b-4d97-a99a-ec9c8b57729a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.625235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6741f68-af8b-4d97-a99a-ec9c8b57729a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.640741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1033/2088] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:31.640741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ddb5b-1538-4c47-b6eb-74da7d31c7c2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.640741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ddb5b-1538-4c47-b6eb-74da7d31c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.640741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ddb5b-1538-4c47-b6eb-74da7d31c7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.662299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e32ddb5b-1538-4c47-b6eb-74da7d31c7c2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:31.663221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e32ddb5b-1538-4c47-b6eb-74da7d31c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.671524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1034/2089] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:31.672432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ddb5b-1538-4c47-b6eb-74da7d31c7c2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.678270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1056/2090] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:31.678270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cd5fa-59af-4796-9416-0dd720b520ea None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.682809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ddb5b-1538-4c47-b6eb-74da7d31c7c2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.690341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.691110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.691464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.691805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.692069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cd5fa-59af-4796-9416-0dd720b520ea None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.692681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.694388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.697087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.697915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.698305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.698658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.699458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:31.700036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.701499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.714459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1035/2091] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:31.714459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.714459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.715753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1057/2092] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:45:31.715753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.726100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259f0a7-2792-4e23-8f9e-d24a37ca7db9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.731625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785a2b-7902-4cc7-b6e1-121a4472b43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.732345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785a2b-7902-4cc7-b6e1-121a4472b43f admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.732823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785a2b-7902-4cc7-b6e1-121a4472b43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.733066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785a2b-7902-4cc7-b6e1-121a4472b43f admin admin] PATH_INFO: `/v3/projects/b1d4092319204b878a7b58b7c31d736d/users/715c689014c44bdfb346bdff4d1b4458/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.748845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d785a2b-7902-4cc7-b6e1-121a4472b43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d4092319204b878a7b58b7c31d736d, user_id=715c689014c44bdfb346bdff4d1b4458, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.751533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d785a2b-7902-4cc7-b6e1-121a4472b43f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.770500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b368b50-8718-4031-b063-dced7726cd4c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.774234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.774900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.775183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.775459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.784198 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.785936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.794989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1036/2093] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:31.795762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.834138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927653d-2a3e-4b79-a9e2-83d3538117a3 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:31.836322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1058/2094] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:31 2022] PUT /identity/v3/projects/b1d4092319204b878a7b58b7c31d736d/users/715c689014c44bdfb346bdff4d1b4458/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:31.838762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.839766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.842614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.896449 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] MFA Rules not processed for user `715c689014c44bdfb346bdff4d1b4458`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:31.897677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:31.923540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:31.925166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:31.925655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:31.926141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:31.927055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:31.929331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:31.971922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1059/2095] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:31.983186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:31.984468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:32.044051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc6ae6-cafd-4152-a54d-4dbbf328075b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.048342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1037/2096] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:31 2022] POST /identity/v3/projects => generated 365 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:32.049938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.052242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:32.093529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.094167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.094481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.094761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.118112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f660-c084-4aca-8e7d-228021643f3f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.122832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.123683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.123968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.124244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] PATH_INFO: `/v3/projects/8085c1929dfa44f49f7439a53eaf829a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.125471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8085c1929dfa44f49f7439a53eaf829a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.127483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.153071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.154852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.168533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1060/2097] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:32.169415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.181466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3a9e-99b8-4dcb-b04f-c06b72a9d226 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.186163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.186853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.187136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.187409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.188108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.190392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.264667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8085c1929dfa44f49f7439a53eaf829a', 'request_id': 'req-6c02272a-f60b-4fe7-a9da-efff2513c106'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:32.270410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8085c1929dfa44f49f7439a53eaf829a', 'request_id': 'req-6c02272a-f60b-4fe7-a9da-efff2513c106'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:32.285655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1061/2098] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:32 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:32.290257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.306565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873565-460a-449c-8cf9-399073e24a5e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.362163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.362867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.363156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.363440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.364155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.365795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.375374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1062/2099] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:32.378698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8085c1929dfa44f49f7439a53eaf829a', 'request_id': 'req-6c02272a-f60b-4fe7-a9da-efff2513c106'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:32.385467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.391803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] The token cache is being invalidate because project 8085c1929dfa44f49f7439a53eaf829a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:32.392096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:32.393312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6c02272a-f60b-4fe7-a9da-efff2513c106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:32.395324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1038/2100] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:32 2022] DELETE /identity/v3/projects/8085c1929dfa44f49f7439a53eaf829a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:32.397554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470b0a2-0ca7-401c-8d25-d00261e5289b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.400384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d886-cffd-4845-966a-608d738074b1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.400847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d886-cffd-4845-966a-608d738074b1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.401201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d886-cffd-4845-966a-608d738074b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.402860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.407516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.407516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.407516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.407516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.407516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.420187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fae0d886-cffd-4845-966a-608d738074b1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:32.421410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fae0d886-cffd-4845-966a-608d738074b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:32.422521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1063/2101] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:32.424171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.425796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:32.431149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1039/2102] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:32.442909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719095e3-5f03-48d9-b55a-ef26db266326 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.444111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984220c5-e8fb-4d99-b054-2013651a30cc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.444403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984220c5-e8fb-4d99-b054-2013651a30cc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.444680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984220c5-e8fb-4d99-b054-2013651a30cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.447158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa8500-97ca-4634-b959-23881b6f9732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.448047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa8500-97ca-4634-b959-23881b6f9732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.448340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa8500-97ca-4634-b959-23881b6f9732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.448615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa8500-97ca-4634-b959-23881b6f9732 admin admin] PATH_INFO: `/v3/projects/f24888e6529a4acab5761b5f7ce14034/users/1b8dc16708b048d0b5e233ddab74091a/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.463521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-984220c5-e8fb-4d99-b054-2013651a30cc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:32.464351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa8500-97ca-4634-b959-23881b6f9732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24888e6529a4acab5761b5f7ce14034, user_id=1b8dc16708b048d0b5e233ddab74091a, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.464847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-984220c5-e8fb-4d99-b054-2013651a30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:32.467205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa8500-97ca-4634-b959-23881b6f9732 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.477256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1040/2103] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:32.478456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984220c5-e8fb-4d99-b054-2013651a30cc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.497225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984220c5-e8fb-4d99-b054-2013651a30cc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.504882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.505567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.505856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.506161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.506890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:32.507202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.508816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.524806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1041/2104] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:32.525925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.536409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f6ba-4164-48fe-9766-93c6072e480f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.541276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.543056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.543056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.543056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.543303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.545204 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.572939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1064/2105] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:32 2022] PUT /identity/v3/projects/f24888e6529a4acab5761b5f7ce14034/users/1b8dc16708b048d0b5e233ddab74091a/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:32.583624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.583917 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.584197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.612093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] MFA Rules not processed for user `1b8dc16708b048d0b5e233ddab74091a`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:32.613606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:32.645943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1042/2106] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:32 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:32.649038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.693569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1065/2107] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:32.701013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.703046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:32.731009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde51acd-3609-4e18-b34d-822a9d94544d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.744841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.745043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.745152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.745560 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.746807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.748899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.767581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:32.773824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c33db-6cb0-4a15-830a-412c1251bd88 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.823754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.824418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.824705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.824989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.865462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1043/2108] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:32 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:32.869607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.880977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f384611-3979-48ac-b969-e0b46f55a3a0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.885452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.886123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.886762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.888014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.888014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.889349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.897396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.900542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1044/2109] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:32.900726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.904295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.910948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1066/2110] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:32.914668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1cb7-cb34-4cf1-9786-5a70b6ef53f3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.922877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1512-9376-4aba-af57-669fc1570ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.922877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1512-9376-4aba-af57-669fc1570ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.922877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1512-9376-4aba-af57-669fc1570ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.922877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1512-9376-4aba-af57-669fc1570ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.923384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc1512-9376-4aba-af57-669fc1570ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.923655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc1512-9376-4aba-af57-669fc1570ae7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.938994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1045/2111] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:32.943481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:32.955377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330e418-4b1c-4593-893c-11fa6a7aeb5f service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:32.960734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:32.962537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:32.962537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:32.962537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] PATH_INFO: `/v3/projects/7157d8a7280541ed804c5019df7fd56e/users/b55954c1f0b7463a9741d5e64ce3f68a/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:32.978321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7157d8a7280541ed804c5019df7fd56e, user_id=b55954c1f0b7463a9741d5e64ce3f68a, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:32.981211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:32.996823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:33.063157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1067/2112] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:32 2022] PUT /identity/v3/projects/7157d8a7280541ed804c5019df7fd56e/users/b55954c1f0b7463a9741d5e64ce3f68a/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:33.075126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ca8-1e05-4127-bf21-c2348b73c952 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:33.075417 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ca8-1e05-4127-bf21-c2348b73c952 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:33.075694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ca8-1e05-4127-bf21-c2348b73c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:33.101020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2f773ca8-1e05-4127-bf21-c2348b73c952 None None] MFA Rules not processed for user `b55954c1f0b7463a9741d5e64ce3f68a`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:33.102203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2f773ca8-1e05-4127-bf21-c2348b73c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:33.169269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1046/2113] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:33.181030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:33.182785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:33.239983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f4a84-b49a-4c6b-871d-e3f381767ff1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:33.243672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ab418-d335-4aa1-b495-bd141d985d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:33.244458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab418-d335-4aa1-b495-bd141d985d73 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:33.244726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab418-d335-4aa1-b495-bd141d985d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:33.245007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab418-d335-4aa1-b495-bd141d985d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:33.258440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ab418-d335-4aa1-b495-bd141d985d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:33.258440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ab418-d335-4aa1-b495-bd141d985d73 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:33.264714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1068/2114] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:33.283944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773ca8-1e05-4127-bf21-c2348b73c952 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:33.346825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773ca8-1e05-4127-bf21-c2348b73c952 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:33.351485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:33.352355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:33.352641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:33.352919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] PATH_INFO: `/v3/users/b55954c1f0b7463a9741d5e64ce3f68a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:33.354134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55954c1f0b7463a9741d5e64ce3f68a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:33.356080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:33.535786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55954c1f0b7463a9741d5e64ce3f68a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:33.543035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55954c1f0b7463a9741d5e64ce3f68a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:33.613644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:33.635587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55954c1f0b7463a9741d5e64ce3f68a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:33.648957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55954c1f0b7463a9741d5e64ce3f68a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:33.651075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55954c1f0b7463a9741d5e64ce3f68a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:33.656633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1047/2115] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:33 2022] DELETE /identity/v3/users/b55954c1f0b7463a9741d5e64ce3f68a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:33.662048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:33.662539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:33.662635 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:33.683143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:33.684477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:33.746762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1069/2116] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:33.756488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:33.757922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:33.814581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54f786-9f49-4eff-b557-cc61c36fd94a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:33.818059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8253-42d3-4f90-b79d-dadeaf33e3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:33.818726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8253-42d3-4f90-b79d-dadeaf33e3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:33.819007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8253-42d3-4f90-b79d-dadeaf33e3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:33.819281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8253-42d3-4f90-b79d-dadeaf33e3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:33.828034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8253-42d3-4f90-b79d-dadeaf33e3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:33.829460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8253-42d3-4f90-b79d-dadeaf33e3b6 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:33.830818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:33.839273 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1048/2117] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:34.257307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:34.380477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:34.381938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:34.395467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a423c-c0f7-45ea-bc15-4c3395a3c711 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:34.400431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:34.401309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:34.401592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:34.401867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] PATH_INFO: `/v3/projects/7157d8a7280541ed804c5019df7fd56e` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:34.403142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7157d8a7280541ed804c5019df7fd56e)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:34.405103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:34.510481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7157d8a7280541ed804c5019df7fd56e', 'request_id': 'req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:34.516073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7157d8a7280541ed804c5019df7fd56e', 'request_id': 'req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:34.593985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7157d8a7280541ed804c5019df7fd56e', 'request_id': 'req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:34.594147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:34.601590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] The token cache is being invalidate because project 7157d8a7280541ed804c5019df7fd56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:34.601877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:34.602525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0b978c7e-d0b8-428d-b8c1-3bcfe980b0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:34.604065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1070/2118] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:34 2022] DELETE /identity/v3/projects/7157d8a7280541ed804c5019df7fd56e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:34.610131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb899-e9b7-436c-8199-1d2946a5e1d1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:34.610438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb899-e9b7-436c-8199-1d2946a5e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:34.610721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb899-e9b7-436c-8199-1d2946a5e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:34.631447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c3edb899-e9b7-436c-8199-1d2946a5e1d1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:34.632676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c3edb899-e9b7-436c-8199-1d2946a5e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:34.694715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1049/2119] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:34.702280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c401-a500-4137-91fa-cbf8833ba190 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:34.702730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c401-a500-4137-91fa-cbf8833ba190 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:34.702841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c401-a500-4137-91fa-cbf8833ba190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:34.724526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4640c401-a500-4137-91fa-cbf8833ba190 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:34.725889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4640c401-a500-4137-91fa-cbf8833ba190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:34.739530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1071/2120] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:34.743494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb899-e9b7-436c-8199-1d2946a5e1d1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:34.753787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb899-e9b7-436c-8199-1d2946a5e1d1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:34.768434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:34.769253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:34.770293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:34.770293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:34.770762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:34.771030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:34.772761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:34.787360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1050/2121] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:34.791730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c401-a500-4137-91fa-cbf8833ba190 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:34.802552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c401-a500-4137-91fa-cbf8833ba190 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:34.807888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:34.808850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:34.809140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:34.809606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:34.810333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:34.815470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:34.955958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1072/2122] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:34 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:34.960117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:34.970275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53addf-d5c4-4f78-8aca-fe29bbd5b23f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:35.026363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:35.027034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:35.027321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:35.027601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:35.028296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:35.030326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:35.153707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1051/2123] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:34 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:35.154981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:35.166698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1cf9b-665c-4a77-bf78-497015355484 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:35.171986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:35.173054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:35.173656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:35.174137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:35.175511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:35.177417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:35.198306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1073/2124] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:35.202439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:35.214069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9d3b-b5fb-4d33-80a9-e9f36ad54872 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:35.222138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb6052-f3b6-4676-9564-a99ac39b008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:35.223165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb6052-f3b6-4676-9564-a99ac39b008f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:35.223619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb6052-f3b6-4676-9564-a99ac39b008f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:35.223902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb6052-f3b6-4676-9564-a99ac39b008f admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:35.224636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb6052-f3b6-4676-9564-a99ac39b008f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:35.226391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb6052-f3b6-4676-9564-a99ac39b008f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:35.240284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1052/2125] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:35.245509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:35.255727 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3069-e1bf-431b-bc11-c709ba5f4bb9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:35.260527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:35.261423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:35.261710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:35.261981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] PATH_INFO: `/v3/projects/a4333809030a406d8e71ea5f062a99a5/users/8e03c4a5f1d3433898c9eeca8ac66a50/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:35.280158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4333809030a406d8e71ea5f062a99a5, user_id=8e03c4a5f1d3433898c9eeca8ac66a50, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:35.284240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:35.504544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1074/2126] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:35 2022] PUT /identity/v3/projects/a4333809030a406d8e71ea5f062a99a5/users/8e03c4a5f1d3433898c9eeca8ac66a50/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:35.515856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:35.516160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:35.516446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:35.544294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] MFA Rules not processed for user `8e03c4a5f1d3433898c9eeca8ac66a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:35.545507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:35.567596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:35.616643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1053/2127] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:35.627252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:35.628927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:35.690764 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95639-d147-4e39-bd4d-7652614ac88f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:35.694588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e73f0-9fcc-410d-a2c6-d6494df1f7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:35.695243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e73f0-9fcc-410d-a2c6-d6494df1f7fe service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:35.695531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e73f0-9fcc-410d-a2c6-d6494df1f7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:35.695810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e73f0-9fcc-410d-a2c6-d6494df1f7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:35.704364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e73f0-9fcc-410d-a2c6-d6494df1f7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:35.706417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e73f0-9fcc-410d-a2c6-d6494df1f7fe service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:35.716065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1075/2128] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:36.322962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:37.013333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:37.277873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:38.156335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:38.823648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:39.177523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:40.367652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:40.520446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:41.703366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:41.853958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:42.867168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:43.137562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:43.447297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:43.449200 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:43.523807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8d35-de28-4aa6-bfcf-8b4f288a7aee None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:43.528569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:43.529507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:43.529864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:43.530151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] PATH_INFO: `/v3/users/1b8dc16708b048d0b5e233ddab74091a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:43.531404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8dc16708b048d0b5e233ddab74091a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:43.533950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:43.707648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8dc16708b048d0b5e233ddab74091a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:43.714496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8dc16708b048d0b5e233ddab74091a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:43.778800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8dc16708b048d0b5e233ddab74091a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:43.791975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8dc16708b048d0b5e233ddab74091a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:43.792611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8dc16708b048d0b5e233ddab74091a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:43.798491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1054/2129] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:43 2022] DELETE /identity/v3/users/1b8dc16708b048d0b5e233ddab74091a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:43.802945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:43.803244 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:43.803531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:43.820703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:43.822016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:43.881751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1076/2130] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:43.893136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:43.894648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:43.943224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:43.943224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:43.953242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c3c5-d3cc-434b-bc52-7cd1cc87eb3d None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:43.953376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68777818-59c6-4e76-a580-581d16e2d18d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:43.957526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a6dce-cba2-45a1-b03a-c53be3f71ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:43.958175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6dce-cba2-45a1-b03a-c53be3f71ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:43.958498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6dce-cba2-45a1-b03a-c53be3f71ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:43.958752 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:43.958875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6dce-cba2-45a1-b03a-c53be3f71ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:43.959607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:43.959901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:43.960177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] PATH_INFO: `/v3/users/8e03c4a5f1d3433898c9eeca8ac66a50` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:43.961358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e03c4a5f1d3433898c9eeca8ac66a50)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:43.963339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:43.968035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a6dce-cba2-45a1-b03a-c53be3f71ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:43.969459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a6dce-cba2-45a1-b03a-c53be3f71ad7 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:43.979351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1055/2131] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:44.210681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e03c4a5f1d3433898c9eeca8ac66a50'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.213635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:44.218533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e03c4a5f1d3433898c9eeca8ac66a50'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.219437 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e03c4a5f1d3433898c9eeca8ac66a50'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.220478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e03c4a5f1d3433898c9eeca8ac66a50'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.297608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e03c4a5f1d3433898c9eeca8ac66a50'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.316578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1077/2132] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:43 2022] DELETE /identity/v3/users/8e03c4a5f1d3433898c9eeca8ac66a50 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:44.321139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:44.321439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:44.321727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:44.340771 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:44.342010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:44.385384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:44.392275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:44.393956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:44.412429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1056/2133] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:44.418423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:44.419910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:44.483435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ab0f-a1ee-4c8a-948f-96726c01fddc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:44.487689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72165d31-72d3-4b97-8f0d-16ca6cf77a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:44.488406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165d31-72d3-4b97-8f0d-16ca6cf77a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:44.489137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165d31-72d3-4b97-8f0d-16ca6cf77a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:44.489604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165d31-72d3-4b97-8f0d-16ca6cf77a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:44.500541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72165d31-72d3-4b97-8f0d-16ca6cf77a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:44.502126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee67f-7a54-45ee-ac59-4f5062099989 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:44.502310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72165d31-72d3-4b97-8f0d-16ca6cf77a66 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:44.508264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:44.509178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:44.509476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:44.509759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] PATH_INFO: `/v3/projects/f24888e6529a4acab5761b5f7ce14034` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:44.511150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24888e6529a4acab5761b5f7ce14034)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:44.512240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1057/2134] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:44.513388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:44.645826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24888e6529a4acab5761b5f7ce14034', 'request_id': 'req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.652887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24888e6529a4acab5761b5f7ce14034', 'request_id': 'req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.738922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24888e6529a4acab5761b5f7ce14034', 'request_id': 'req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.750777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] The token cache is being invalidate because project f24888e6529a4acab5761b5f7ce14034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:44.751070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.751795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38b45d5b-18a2-4bfb-9c50-f2d1d9b7ceb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:44.753952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1078/2135] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:44 2022] DELETE /identity/v3/projects/f24888e6529a4acab5761b5f7ce14034 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:44.758852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc680-11ba-4503-b0fc-bc5fc6015743 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:44.759145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc680-11ba-4503-b0fc-bc5fc6015743 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:44.759420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc680-11ba-4503-b0fc-bc5fc6015743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:44.778329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-36cbc680-11ba-4503-b0fc-bc5fc6015743 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:44.779531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-36cbc680-11ba-4503-b0fc-bc5fc6015743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:44.852942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1058/2136] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:44.860914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423be4-5679-4377-9e26-8b1bd1424a4b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:44.861208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423be4-5679-4377-9e26-8b1bd1424a4b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:44.861528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423be4-5679-4377-9e26-8b1bd1424a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:44.881178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e5423be4-5679-4377-9e26-8b1bd1424a4b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:44.882433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e5423be4-5679-4377-9e26-8b1bd1424a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:44.891637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1079/2137] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:44.897155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbc680-11ba-4503-b0fc-bc5fc6015743 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:44.908140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbc680-11ba-4503-b0fc-bc5fc6015743 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:44.913041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:44.918012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:44.918012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:44.918012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:44.918012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:44.918012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:44.918012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:44.930243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1059/2138] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:44.934033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5423be4-5679-4377-9e26-8b1bd1424a4b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:44.944830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5423be4-5679-4377-9e26-8b1bd1424a4b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:44.949958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:44.950685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:44.950973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:44.951255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:44.951949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:44.953934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.061337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.062299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:45.069551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1080/2139] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:44 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:45.074816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.078309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d615f8-0283-4938-b65e-a6433be14fef admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.148095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94840d70-a0a9-4964-a5e3-708eaa6e5332 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.153416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.153564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.154096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.155334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.155427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.155513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.155596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.155678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] PATH_INFO: `/v3/projects/a4333809030a406d8e71ea5f062a99a5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.155773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:45.156220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4333809030a406d8e71ea5f062a99a5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:45.157320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.158123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.258546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1081/2140] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:45 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:45.262529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.272058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05171-7aa7-4fd4-b1a0-1792e02b6b89 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.276817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.283554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.283554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.283554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.283554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:45.283554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.291850 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1082/2141] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:45.295332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.312527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81c7a-a5d8-4915-9921-a4156e86580e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.318683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4333809030a406d8e71ea5f062a99a5', 'request_id': 'req-17890463-25ae-4cd3-bac5-3df56f09797f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:45.324231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4333809030a406d8e71ea5f062a99a5', 'request_id': 'req-17890463-25ae-4cd3-bac5-3df56f09797f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:45.363425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.364104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.364422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.364700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.365473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:45.367067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.376997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1083/2142] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:45.383123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.393507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758f4e-b868-4f9a-9bf1-e08adf375801 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.398069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.398972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.399467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.399563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] PATH_INFO: `/v3/projects/af93597598534f4a83976c71f778e023/users/77382deeef2644bb9e735cc5ae005707/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.414625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af93597598534f4a83976c71f778e023, user_id=77382deeef2644bb9e735cc5ae005707, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:45.417342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.418723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4333809030a406d8e71ea5f062a99a5', 'request_id': 'req-17890463-25ae-4cd3-bac5-3df56f09797f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:45.430945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] The token cache is being invalidate because project a4333809030a406d8e71ea5f062a99a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:45.431230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:45.431888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-17890463-25ae-4cd3-bac5-3df56f09797f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:45.440018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1060/2143] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:45 2022] DELETE /identity/v3/projects/a4333809030a406d8e71ea5f062a99a5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:45.494724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1084/2144] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:45 2022] PUT /identity/v3/projects/af93597598534f4a83976c71f778e023/users/77382deeef2644bb9e735cc5ae005707/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:45.506596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f2d2-9d2c-4c95-9194-629a136937cc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.506892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f2d2-9d2c-4c95-9194-629a136937cc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.507203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f2d2-9d2c-4c95-9194-629a136937cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.538731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e279f2d2-9d2c-4c95-9194-629a136937cc None None] MFA Rules not processed for user `77382deeef2644bb9e735cc5ae005707`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:45.548828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e279f2d2-9d2c-4c95-9194-629a136937cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:45.621584 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1061/2145] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:45.626180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.628570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:45.693951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b4573-8a4f-49a2-9640-0545a3bc5f45 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.699370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.700038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.700323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.700600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.701312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:45.704311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.786779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1085/2146] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:45 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:45.790883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f2d2-9d2c-4c95-9194-629a136937cc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.802321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f2d2-9d2c-4c95-9194-629a136937cc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.860101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.860778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.861065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:45.861881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:45.862664 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:45.864620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:45.978825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1062/2147] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:45 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:45.981935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:45.993559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303226b2-c32e-4b50-ae5a-65d14172ee8c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:45.998682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:45.999479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:45.999853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:46.000135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:46.000870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:46.003416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:46.016123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1086/2148] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:46.023434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:46.025602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:46.037438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c51574-cf7f-4b4f-8e1e-3a316c37e124 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:46.042394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:46.043321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:46.043641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:46.043924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] PATH_INFO: `/v3/projects/6006546d92af47f2a481c44b4bf70c4c/users/1b8a6532006d405896a1a6956d9f8205/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:46.059615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6006546d92af47f2a481c44b4bf70c4c, user_id=1b8a6532006d405896a1a6956d9f8205, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:46.062888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:46.197172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1063/2149] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:46 2022] PUT /identity/v3/projects/6006546d92af47f2a481c44b4bf70c4c/users/1b8a6532006d405896a1a6956d9f8205/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:46.201260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:46.211711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce65aa1-84f7-442f-8326-5551e2001103 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:46.267060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ab425-9bc3-436d-b228-2968d0013eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:46.268045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab425-9bc3-436d-b228-2968d0013eec admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:46.268416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab425-9bc3-436d-b228-2968d0013eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:46.268692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab425-9bc3-436d-b228-2968d0013eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:46.274745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ab425-9bc3-436d-b228-2968d0013eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:46.274745 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ab425-9bc3-436d-b228-2968d0013eec admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:46.284806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1087/2150] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:46.288615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:46.301434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e0608-fac9-4851-95c7-2ecc2ceb9908 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:46.306197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:46.307111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:46.307432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:46.307713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] PATH_INFO: `/v3/projects/6006546d92af47f2a481c44b4bf70c4c/users/1b8a6532006d405896a1a6956d9f8205/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:46.309688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6006546d92af47f2a481c44b4bf70c4c, user_id=1b8a6532006d405896a1a6956d9f8205, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:46.312360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:46.324979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1064/2151] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:46 2022] PUT /identity/v3/projects/6006546d92af47f2a481c44b4bf70c4c/users/1b8a6532006d405896a1a6956d9f8205/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:46.342769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:46.343057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:46.343333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:46.371105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] MFA Rules not processed for user `1b8a6532006d405896a1a6956d9f8205`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:46.372298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:46.442160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1088/2152] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:46.443377 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:46.453404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:46.455079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:46.513294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1139954-9cb7-4dc1-adab-39f0877d605d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:46.517110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65c822-efd5-46b3-9153-f8cfa0e1391c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:46.517746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c822-efd5-46b3-9153-f8cfa0e1391c service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:46.518027 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c822-efd5-46b3-9153-f8cfa0e1391c service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:46.518344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c822-efd5-46b3-9153-f8cfa0e1391c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:46.575865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65c822-efd5-46b3-9153-f8cfa0e1391c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:46.577431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65c822-efd5-46b3-9153-f8cfa0e1391c service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:46.587228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1065/2153] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:47.181954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:47.183506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:47.265965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766232-e12e-41ef-bec5-4f12b20eb695 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:47.271460 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:47.273127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:47.273569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:47.273997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] PATH_INFO: `/v3/users/852e8ed4edd54fdb8f0b23b0c07b4700` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:47.276050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852e8ed4edd54fdb8f0b23b0c07b4700)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:47.278151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:47.496852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852e8ed4edd54fdb8f0b23b0c07b4700'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:47.505076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852e8ed4edd54fdb8f0b23b0c07b4700'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:47.505739 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852e8ed4edd54fdb8f0b23b0c07b4700'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:47.506406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852e8ed4edd54fdb8f0b23b0c07b4700'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:47.576694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852e8ed4edd54fdb8f0b23b0c07b4700'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:47.604898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1089/2154] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:47 2022] DELETE /identity/v3/users/852e8ed4edd54fdb8f0b23b0c07b4700 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:47.609569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:47.610033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:47.610249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:47.641133 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:47.643287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:47.707467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1066/2155] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:47.717159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:47.718647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:47.782500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fb3bc-93fc-4965-a1a3-8185b6840734 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:47.786539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:47.787193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:47.787479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:47.787756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:47.797137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:47.798489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:47.807553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:47.810530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1090/2156] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:47.945293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:48.528766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:48.535522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:48.548873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020dfad-af08-473f-850d-52683b91ecfa None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:48.554746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:48.555644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:48.555935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:48.556210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] PATH_INFO: `/v3/projects/3f6a3e687fcc40ceb8f89fc4cc9755ba` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:48.557807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6a3e687fcc40ceb8f89fc4cc9755ba)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:48.559748 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:48.640282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:48.640282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:48.696226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6a3e687fcc40ceb8f89fc4cc9755ba', 'request_id': 'req-76419c6a-db2b-441f-9bc6-380ddb81c1a0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:48.703583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6a3e687fcc40ceb8f89fc4cc9755ba', 'request_id': 'req-76419c6a-db2b-441f-9bc6-380ddb81c1a0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:48.711539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda7e4-6c64-4ce5-849a-32bb2bbed892 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:48.770587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35948c-a22d-4f69-b479-f3dba83d5dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:48.771404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35948c-a22d-4f69-b479-f3dba83d5dcc service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:48.771700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35948c-a22d-4f69-b479-f3dba83d5dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:48.771990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35948c-a22d-4f69-b479-f3dba83d5dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:48.774005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cc35948c-a22d-4f69-b479-f3dba83d5dcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:48.840277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6a3e687fcc40ceb8f89fc4cc9755ba', 'request_id': 'req-76419c6a-db2b-441f-9bc6-380ddb81c1a0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:48.842533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:48.848364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35948c-a22d-4f69-b479-f3dba83d5dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:48.850371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35948c-a22d-4f69-b479-f3dba83d5dcc service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:48.853166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] The token cache is being invalidate because project 3f6a3e687fcc40ceb8f89fc4cc9755ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:48.853581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:48.854412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:48.859373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1067/2157] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:48 2022] DELETE /identity/v3/projects/3f6a3e687fcc40ceb8f89fc4cc9755ba => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:48.860348 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:48.862444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:48.865170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1091/2158] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:48.872972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06069-fd7d-4e27-beeb-c38576ad907c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:48.873525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06069-fd7d-4e27-beeb-c38576ad907c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:48.873993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06069-fd7d-4e27-beeb-c38576ad907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:48.899500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-16a06069-fd7d-4e27-beeb-c38576ad907c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:48.900832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-16a06069-fd7d-4e27-beeb-c38576ad907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:48.969740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:48.982382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419c6a-db2b-441f-9bc6-380ddb81c1a0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:48.990867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1092/2159] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:48.996324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb878c-3bcc-4119-911d-0f9abc62ce01 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:48.996610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb878c-3bcc-4119-911d-0f9abc62ce01 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:48.996890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb878c-3bcc-4119-911d-0f9abc62ce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.004013 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.004972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.009960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.009960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] PATH_INFO: `/v3/users/fc394c9ad9ed4b09bebc24ad11518d28` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.009960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc394c9ad9ed4b09bebc24ad11518d28)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.009960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.019470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a7fb878c-3bcc-4119-911d-0f9abc62ce01 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:49.020904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a7fb878c-3bcc-4119-911d-0f9abc62ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:49.031852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1093/2160] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:49.039781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb878c-3bcc-4119-911d-0f9abc62ce01 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.049965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb878c-3bcc-4119-911d-0f9abc62ce01 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.056886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.057796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.058159 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.058553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.059393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:49.059835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.061670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.078242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1094/2161] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:49.083957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.099597 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a82e9c-7261-43ab-b715-61f00614f768 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.105360 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.106151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.106564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.108465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.108465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.109947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.242872 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1095/2162] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:49 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:49.247095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.248996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc394c9ad9ed4b09bebc24ad11518d28'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:49.256583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc394c9ad9ed4b09bebc24ad11518d28'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:49.317515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a44dc7-36aa-48dd-8a1c-68a7ed899f68 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.324009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.324665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.324955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.325237 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.326344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.328994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.396338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc394c9ad9ed4b09bebc24ad11518d28'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:49.410283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc394c9ad9ed4b09bebc24ad11518d28'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:49.411068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb7921c8-a237-488e-b3e6-ac4185963f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc394c9ad9ed4b09bebc24ad11518d28'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:49.417195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1068/2163] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:48 2022] DELETE /identity/v3/users/fc394c9ad9ed4b09bebc24ad11518d28 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:49.421724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261e6-00d1-4c97-af1e-9af1940ffb37 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.422022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261e6-00d1-4c97-af1e-9af1940ffb37 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.422338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261e6-00d1-4c97-af1e-9af1940ffb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.432951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1096/2164] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:49 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:49.436665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.438892 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:49.453174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:49.455741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9de261e6-00d1-4c97-af1e-9af1940ffb37 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:49.457124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00241da4-b29e-42f3-8071-7595553c299b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.457511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9de261e6-00d1-4c97-af1e-9af1940ffb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:49.517924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.518757 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.519222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.519455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.520254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.521929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.530002 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1069/2165] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:49.534248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1097/2166] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:49.536539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261e6-00d1-4c97-af1e-9af1940ffb37 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.540693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.543059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:49.548535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261e6-00d1-4c97-af1e-9af1940ffb37 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.551380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.553206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.553677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.553824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.555042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.556377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.573331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1070/2167] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:49.576961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.584557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501925ed-3cde-4556-b7dd-26bfefbc2c43 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.589189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.590054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.590390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.590649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] PATH_INFO: `/v3/projects/b7db5e527d1940c7b1326950aa4655c0/users/b538cbd70f72473fabee18d02c324b1e/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.605794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2d2f-b349-4754-b7ba-185f571fb828 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.608271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7db5e527d1940c7b1326950aa4655c0, user_id=b538cbd70f72473fabee18d02c324b1e, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.609395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba46fd8-b29c-4d7d-bbde-3569d9795f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.611401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba46fd8-b29c-4d7d-bbde-3569d9795f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.611401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba46fd8-b29c-4d7d-bbde-3569d9795f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.611401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba46fd8-b29c-4d7d-bbde-3569d9795f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.611661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.620257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba46fd8-b29c-4d7d-bbde-3569d9795f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.621795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba46fd8-b29c-4d7d-bbde-3569d9795f54 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.630134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:49.634303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1098/2168] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:49.717511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1071/2169] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:49 2022] PUT /identity/v3/projects/b7db5e527d1940c7b1326950aa4655c0/users/b538cbd70f72473fabee18d02c324b1e/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:49.729412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.729862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.729984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.738829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:49.759707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] MFA Rules not processed for user `b538cbd70f72473fabee18d02c324b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:49.760927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:49.831541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1099/2170] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:49.842102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:49.843813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:49.912373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a681e-dc24-4c24-9ea8-2ba8f6e24881 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:49.917192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652217-cc26-43d7-b56c-e39429917147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:49.918029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652217-cc26-43d7-b56c-e39429917147 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:49.918425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652217-cc26-43d7-b56c-e39429917147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:49.918711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652217-cc26-43d7-b56c-e39429917147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:49.932153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652217-cc26-43d7-b56c-e39429917147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:49.933524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652217-cc26-43d7-b56c-e39429917147 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:49.944166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1072/2171] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:50.120723 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:50.168672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:50.170201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:50.191051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:50.249535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d0362-2e6c-4c67-948b-6048e4a3213c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:50.257665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:50.258582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:50.258866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:50.259150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] PATH_INFO: `/v3/projects/ca003fa93ecc405390596f761c76c5ab` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:50.260809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca003fa93ecc405390596f761c76c5ab)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:50.262906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:50.382138 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca003fa93ecc405390596f761c76c5ab', 'request_id': 'req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:50.387582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca003fa93ecc405390596f761c76c5ab', 'request_id': 'req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:50.475864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca003fa93ecc405390596f761c76c5ab', 'request_id': 'req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:50.489493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] The token cache is being invalidate because project ca003fa93ecc405390596f761c76c5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:50.489762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:50.490433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c245adf1-b26f-4ea3-9147-d24b2b6eaf1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:50.491989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1100/2172] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:50 2022] DELETE /identity/v3/projects/ca003fa93ecc405390596f761c76c5ab => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:50.496884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ace46-dd10-4148-9508-1e13b885de9c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:50.497179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ace46-dd10-4148-9508-1e13b885de9c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:50.497595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ace46-dd10-4148-9508-1e13b885de9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:50.517155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ef4ace46-dd10-4148-9508-1e13b885de9c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:50.518428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ef4ace46-dd10-4148-9508-1e13b885de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:50.580114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1073/2173] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:50.589483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f5e3-8fcd-4dc5-9242-5e04b537c909 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:50.589940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f5e3-8fcd-4dc5-9242-5e04b537c909 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:50.590682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f5e3-8fcd-4dc5-9242-5e04b537c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:50.628442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-3b47f5e3-8fcd-4dc5-9242-5e04b537c909 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:50.630486 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3b47f5e3-8fcd-4dc5-9242-5e04b537c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:50.637620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:50.646285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1101/2174] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:50.650029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ace46-dd10-4148-9508-1e13b885de9c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:50.661877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ace46-dd10-4148-9508-1e13b885de9c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:50.667929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:50.669014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:50.669600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:50.669966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:50.670977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:50.672465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:50.675256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:50.707866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1074/2175] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:50.713901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f5e3-8fcd-4dc5-9242-5e04b537c909 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:50.728680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f5e3-8fcd-4dc5-9242-5e04b537c909 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:50.736135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:50.737570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:50.738070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:50.738070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:50.738817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:50.745847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:50.854497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1102/2176] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:50 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:50.858687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:50.869260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02e892-c7ff-4427-8452-5ca46079aba8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:50.875236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:50.932366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:50.933040 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:50.933328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:50.933615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:50.934341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:50.936279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.029652 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1075/2177] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:50 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:51.034601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.044698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0599051-b18d-4cdc-af7c-c126ffdc32e3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.050067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.050746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.051036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.051340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.052058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.053658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.063920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1103/2178] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:45:51.067904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.078087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d942eb-d764-4836-abfd-a6638eaff9e2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.090991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3710acf-f874-4fc0-b486-81cc85db7e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.090991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710acf-f874-4fc0-b486-81cc85db7e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.090991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710acf-f874-4fc0-b486-81cc85db7e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.090991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710acf-f874-4fc0-b486-81cc85db7e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.091384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3710acf-f874-4fc0-b486-81cc85db7e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.091384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3710acf-f874-4fc0-b486-81cc85db7e70 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.101553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1076/2179] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:51.102782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.110779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:51.114621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83422d60-a22a-409a-951a-d2dc0d15ba5d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.119731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.123753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.123753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.123753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] PATH_INFO: `/v3/projects/b33bfe410df643c18a9694d48b27e469/users/5cfa38a3f4674280873aa253d5265374/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.138061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33bfe410df643c18a9694d48b27e469, user_id=5cfa38a3f4674280873aa253d5265374, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.140975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.230658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1104/2180] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:51 2022] PUT /identity/v3/projects/b33bfe410df643c18a9694d48b27e469/users/5cfa38a3f4674280873aa253d5265374/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:51.241004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f94c3-443d-48b6-a4b0-f1cc5479be6f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.241343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f94c3-443d-48b6-a4b0-f1cc5479be6f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.241895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f94c3-443d-48b6-a4b0-f1cc5479be6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.269241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2c0f94c3-443d-48b6-a4b0-f1cc5479be6f None None] MFA Rules not processed for user `5cfa38a3f4674280873aa253d5265374`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:51.270472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2c0f94c3-443d-48b6-a4b0-f1cc5479be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:51.337400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1077/2181] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:51.341900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.403337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60ff5-cccc-4ed1-8dfb-17c98838f769 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.408046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.409322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.409607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.409881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.410605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.412501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.492881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1105/2182] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:51 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:51.496919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f94c3-443d-48b6-a4b0-f1cc5479be6f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.508109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f94c3-443d-48b6-a4b0-f1cc5479be6f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.562302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.562925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.563213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.563494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.564235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.566759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.658817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1078/2183] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:51 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:51.663073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.673522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a01f-4491-4ae2-8a0c-baf115bc86c9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.678875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.679516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.679790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.680076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.680807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.682464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.695398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1106/2184] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:51.699374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.709896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d8b9b-35af-4349-8251-fefa4e3ac033 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.715919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff85796-92c6-4a71-a02a-14bcda4824d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.720968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85796-92c6-4a71-a02a-14bcda4824d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.720968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85796-92c6-4a71-a02a-14bcda4824d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.720968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85796-92c6-4a71-a02a-14bcda4824d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.720968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff85796-92c6-4a71-a02a-14bcda4824d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.720968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff85796-92c6-4a71-a02a-14bcda4824d3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.730948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1079/2185] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:51.735710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:51.737663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:51.748859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b74c-700a-4596-af25-fbec52fc4a8a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:51.757789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fa718-cbc0-4119-88ce-4b645ed085fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:51.757789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fa718-cbc0-4119-88ce-4b645ed085fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.757789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fa718-cbc0-4119-88ce-4b645ed085fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.757789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fa718-cbc0-4119-88ce-4b645ed085fa admin admin] PATH_INFO: `/v3/projects/4bf31e3da09a4684b7ddae610cbfe05b/users/bff276232f0545eca0e734bdb75e70f6/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.772937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fa718-cbc0-4119-88ce-4b645ed085fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf31e3da09a4684b7ddae610cbfe05b, user_id=bff276232f0545eca0e734bdb75e70f6, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:51.776647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fa718-cbc0-4119-88ce-4b645ed085fa admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:51.808863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff847-73bc-4afd-8b76-c365c19dd859 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.809163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff847-73bc-4afd-8b76-c365c19dd859 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.809444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff847-73bc-4afd-8b76-c365c19dd859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.830249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f34ff847-73bc-4afd-8b76-c365c19dd859 None None] MFA Rules not processed for user `b538cbd70f72473fabee18d02c324b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:51.831373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f34ff847-73bc-4afd-8b76-c365c19dd859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:51.841825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1107/2186] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:51 2022] PUT /identity/v3/projects/4bf31e3da09a4684b7ddae610cbfe05b/users/bff276232f0545eca0e734bdb75e70f6/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:51.852587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fae14-aa5f-4f1e-9e22-672d766155a3 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:51.852998 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fae14-aa5f-4f1e-9e22-672d766155a3 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:51.853351 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fae14-aa5f-4f1e-9e22-672d766155a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:51.854822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:51.885876 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-5a7fae14-aa5f-4f1e-9e22-672d766155a3 None None] MFA Rules not processed for user `bff276232f0545eca0e734bdb75e70f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:51.896631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5a7fae14-aa5f-4f1e-9e22-672d766155a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:51.906242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1080/2187] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:51.967270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:51.994986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1108/2188] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:51.999299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff847-73bc-4afd-8b76-c365c19dd859 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:52.011883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff847-73bc-4afd-8b76-c365c19dd859 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:52.083220 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:52.084031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.084357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.084637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.085340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:52.087385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:52.175810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:52.185951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1081/2189] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:51 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:52.190936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fae14-aa5f-4f1e-9e22-672d766155a3 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:52.213024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fae14-aa5f-4f1e-9e22-672d766155a3 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:52.291506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:52.292345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.294140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.294140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.294140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:52.295963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:52.385622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:52.418769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1109/2190] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:52 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:52.425287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:52.435859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62dbf6-e40b-4aa4-9e05-f1267c985782 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:52.440807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:52.441697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.442404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.442744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.443474 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:52.445069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:52.455739 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1082/2191] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:52.461255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:52.471832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e1dd-b80e-441c-8210-b9139b8dcbec admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:52.476421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:52.477299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.477583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.477858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] PATH_INFO: `/v3/projects/20230012ac7c4a449844bae62983132f/users/c4c818fbad504180a168848f988c67a2/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.493902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20230012ac7c4a449844bae62983132f, user_id=c4c818fbad504180a168848f988c67a2, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:52.496684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:52.606358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1110/2192] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:52 2022] PUT /identity/v3/projects/20230012ac7c4a449844bae62983132f/users/c4c818fbad504180a168848f988c67a2/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:52.610369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:52.620880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dc974-435d-49f2-8c68-1e9da6192425 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:52.634953 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:52.682081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:52.687536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f44e1c-6455-4221-93cd-a4bd0fce7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:52.688335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44e1c-6455-4221-93cd-a4bd0fce7874 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.688621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44e1c-6455-4221-93cd-a4bd0fce7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.688895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44e1c-6455-4221-93cd-a4bd0fce7874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.689641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f44e1c-6455-4221-93cd-a4bd0fce7874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:52.691275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f44e1c-6455-4221-93cd-a4bd0fce7874 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:52.701152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1083/2193] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:52.705840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:52.716756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae34f6-207e-42be-9137-060a0f7e9948 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:52.722337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:52.723229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.723512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.723789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] PATH_INFO: `/v3/projects/20230012ac7c4a449844bae62983132f/users/c4c818fbad504180a168848f988c67a2/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.725812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20230012ac7c4a449844bae62983132f, user_id=c4c818fbad504180a168848f988c67a2, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:52.728494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:52.739003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1111/2194] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:52 2022] PUT /identity/v3/projects/20230012ac7c4a449844bae62983132f/users/c4c818fbad504180a168848f988c67a2/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:52.749900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.750194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.750506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.786889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] MFA Rules not processed for user `c4c818fbad504180a168848f988c67a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:52.788174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:52.796715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:52.859185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1084/2195] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:52.860602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:52.870317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:52.871991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:52.931920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f77a02-6723-4ed5-b3f1-afa6c69dd73a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:52.935940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88276d-75a0-4b4a-b8ca-ed35421f5813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:52.936636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88276d-75a0-4b4a-b8ca-ed35421f5813 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:52.937203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88276d-75a0-4b4a-b8ca-ed35421f5813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:52.937663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88276d-75a0-4b4a-b8ca-ed35421f5813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:52.996190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88276d-75a0-4b4a-b8ca-ed35421f5813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:52.997717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88276d-75a0-4b4a-b8ca-ed35421f5813 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:53.008497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1112/2196] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:53.260791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:53.262263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:53.310275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:53.328851 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770697f-23e7-4f39-b008-1fdef3727904 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:53.334568 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:53.335076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:53.335363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:53.335645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] PATH_INFO: `/v3/users/77382deeef2644bb9e735cc5ae005707` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:53.337146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77382deeef2644bb9e735cc5ae005707)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:53.339368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:53.372732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:53.535959 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77382deeef2644bb9e735cc5ae005707'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:53.542966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77382deeef2644bb9e735cc5ae005707'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:53.607264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77382deeef2644bb9e735cc5ae005707'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:53.620678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77382deeef2644bb9e735cc5ae005707'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:53.621411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77382deeef2644bb9e735cc5ae005707'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:53.627716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1085/2197] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:53 2022] DELETE /identity/v3/users/77382deeef2644bb9e735cc5ae005707 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:53.632684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:53.632975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:53.633250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:53.662668 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:53.664078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:53.739371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1113/2198] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:45:53.749018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:53.750703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:53.815030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72db4-d212-4220-8a91-a9309e223c09 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:53.818952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:53.819593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:53.819878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:53.820154 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:53.832423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:53.833958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:53.844059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1086/2199] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:54.093326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:54.278780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:54.280436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:54.298271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235fd4d-b9e5-4651-9b88-e4fe1152003e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:54.300061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:54.303549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:54.304406 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:54.304688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:54.308690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] PATH_INFO: `/v3/projects/af93597598534f4a83976c71f778e023` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:54.308690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=af93597598534f4a83976c71f778e023)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:54.308690 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:54.616182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af93597598534f4a83976c71f778e023', 'request_id': 'req-ea747da9-7400-4c30-bed3-857b72c4cebd'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:54.622454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af93597598534f4a83976c71f778e023', 'request_id': 'req-ea747da9-7400-4c30-bed3-857b72c4cebd'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:54.700695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af93597598534f4a83976c71f778e023', 'request_id': 'req-ea747da9-7400-4c30-bed3-857b72c4cebd'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:54.726067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] The token cache is being invalidate because project af93597598534f4a83976c71f778e023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:54.726067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:54.742771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:54.748861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1114/2200] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:54 2022] DELETE /identity/v3/projects/af93597598534f4a83976c71f778e023 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:54.752407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:54.763410 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87fd07-3a61-41af-812a-07e74031f94d service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:54.848716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:54.849633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:54.850007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:54.850341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] PATH_INFO: `/v3/users/1b8a6532006d405896a1a6956d9f8205` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:54.851547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8a6532006d405896a1a6956d9f8205)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:54.853672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:54.946443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:55.053396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:55.110318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8a6532006d405896a1a6956d9f8205'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:55.117907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8a6532006d405896a1a6956d9f8205'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:55.207218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:55.208610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:55.213050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8a6532006d405896a1a6956d9f8205'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:55.229564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8a6532006d405896a1a6956d9f8205'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:55.230346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8a6532006d405896a1a6956d9f8205'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:55.236724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1087/2201] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:54 2022] DELETE /identity/v3/users/1b8a6532006d405896a1a6956d9f8205 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:45:55.271290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747da9-7400-4c30-bed3-857b72c4cebd admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:55.331865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8506d-caea-4349-a73d-a595428679ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:55.332632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8506d-caea-4349-a73d-a595428679ca service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:55.333127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8506d-caea-4349-a73d-a595428679ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:55.333375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8506d-caea-4349-a73d-a595428679ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:55.335695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0bb8506d-caea-4349-a73d-a595428679ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:55.402188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8506d-caea-4349-a73d-a595428679ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:55.403842 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8506d-caea-4349-a73d-a595428679ca service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:55.414130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1115/2202] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:55.596581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:55.740092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:55.746904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:55.748761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:55.834657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f947e-7954-4bd8-94cb-cf11e332fea6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:55.845845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:55.846848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:55.847141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:55.847422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] PATH_INFO: `/v3/projects/6006546d92af47f2a481c44b4bf70c4c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:55.848640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6006546d92af47f2a481c44b4bf70c4c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:55.851127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:56.046628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6006546d92af47f2a481c44b4bf70c4c', 'request_id': 'req-7c3fef88-2a91-4142-bf2d-dec634778472'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:56.053519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:56.054747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6006546d92af47f2a481c44b4bf70c4c', 'request_id': 'req-7c3fef88-2a91-4142-bf2d-dec634778472'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:56.154773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6006546d92af47f2a481c44b4bf70c4c', 'request_id': 'req-7c3fef88-2a91-4142-bf2d-dec634778472'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:56.175995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] The token cache is being invalidate because project 6006546d92af47f2a481c44b4bf70c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:45:56.176286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:56.176942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7c3fef88-2a91-4142-bf2d-dec634778472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:56.178716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1088/2203] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:45:55 2022] DELETE /identity/v3/projects/6006546d92af47f2a481c44b4bf70c4c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:56.183715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02093e59-79ca-42ae-8dd9-16802ef3de5f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.184195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02093e59-79ca-42ae-8dd9-16802ef3de5f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.184195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02093e59-79ca-42ae-8dd9-16802ef3de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.202612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-02093e59-79ca-42ae-8dd9-16802ef3de5f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:56.203984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-02093e59-79ca-42ae-8dd9-16802ef3de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:56.259295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:56.267973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1116/2204] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:56.276875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab690-e9ad-4c0b-bd8d-fbc0224bd3fc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.278890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab690-e9ad-4c0b-bd8d-fbc0224bd3fc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.278890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab690-e9ad-4c0b-bd8d-fbc0224bd3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.297592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-27cab690-e9ad-4c0b-bd8d-fbc0224bd3fc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:56.298875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-27cab690-e9ad-4c0b-bd8d-fbc0224bd3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:56.311528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1089/2205] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:56.316332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02093e59-79ca-42ae-8dd9-16802ef3de5f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:56.330064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02093e59-79ca-42ae-8dd9-16802ef3de5f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:56.335371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:56.338397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.338397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.338397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.338397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:45:56.338397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:56.339676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:56.353189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1117/2206] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:45:56.357632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cab690-e9ad-4c0b-bd8d-fbc0224bd3fc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:56.366952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cab690-e9ad-4c0b-bd8d-fbc0224bd3fc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:56.372185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:56.372844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.373132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.373418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.374120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:56.376103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:56.482497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1090/2207] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:56 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:45:56.486713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:56.523881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28259ecb-23f4-44fe-bb37-46334df79b19 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:56.585402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:56.586082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.586403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.586685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.587469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:56.592352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:56.682335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1118/2208] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:56 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:56.685728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:56.721184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc0b05-d6a6-4ee8-ad19-2e11c03e8c93 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:56.726461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:56.727136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.727422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.727698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.728515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:56.730201 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:56.741830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1091/2209] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:56.746618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:56.757592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ed389-5460-4fc7-8969-026885ab0354 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:56.762867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8eb3b0-4859-4f82-b9e4-19a5b6120304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:56.763545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb3b0-4859-4f82-b9e4-19a5b6120304 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.763851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb3b0-4859-4f82-b9e4-19a5b6120304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.764452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb3b0-4859-4f82-b9e4-19a5b6120304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.765363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eb3b0-4859-4f82-b9e4-19a5b6120304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:56.767144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eb3b0-4859-4f82-b9e4-19a5b6120304 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:56.781807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1119/2210] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:56.784063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:56.797941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfcf58-4e91-4fdb-9eaa-a74293bd092b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:56.803468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:56.804364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.804691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.804971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] PATH_INFO: `/v3/projects/a1e4683953e046258b127b58231dda81/users/d5c21a6cca7b48bd9ce741a16da85eb0/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.813213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:56.830530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e4683953e046258b127b58231dda81, user_id=d5c21a6cca7b48bd9ce741a16da85eb0, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:56.830530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:56.853206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:56.905948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1092/2211] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:56 2022] PUT /identity/v3/projects/a1e4683953e046258b127b58231dda81/users/d5c21a6cca7b48bd9ce741a16da85eb0/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:56.916258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:56.921012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:56.921012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:56.955632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] MFA Rules not processed for user `d5c21a6cca7b48bd9ce741a16da85eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:56.957482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:57.029320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:57.074707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1120/2212] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:57.079358 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:57.202547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760fcb7-9105-495a-99cb-4e591b4e9bba admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:57.208401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:57.209012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.209301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.209582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.210528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:57.212575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:57.284980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:57.284980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:57.363485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d6ecc-855c-452e-a0e6-26d0d8201073 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:57.367711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:57.368371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.368656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.368934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.371286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:57.373261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1093/2213] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:45:57 2022] POST /identity/v3/projects => generated 383 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:57.374401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:57.441914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a905-1fc3-4017-a49c-d1769663e8f6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:57.443224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:57.444933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:57.448047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:57.448371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.448724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.449069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.449899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:57.452152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:57.458812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1121/2214] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:57.555947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1094/2215] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:45:57 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:45:57.560161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:57.571444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea300-516d-494e-ab64-db4054e5b9c9 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:57.576380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:57.577266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.577557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.577857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.578604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:57.580461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:57.591227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1122/2216] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:57.595490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:57.606409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c13f9-12e8-406b-aa3b-3d5bb704e515 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:57.611191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:57.615811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.615811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.615811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] PATH_INFO: `/v3/projects/51faed4c5f4d455884ffcca01c885fdc/users/c3c6ab6e720948b9ad6dc0120cab5154/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.631279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51faed4c5f4d455884ffcca01c885fdc, user_id=c3c6ab6e720948b9ad6dc0120cab5154, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:57.634008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:57.673416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:57.739267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1095/2217] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:57 2022] PUT /identity/v3/projects/51faed4c5f4d455884ffcca01c885fdc/users/c3c6ab6e720948b9ad6dc0120cab5154/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:57.744905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:57.762061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca64233-1605-44a1-b1b3-503a95ac612d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:57.793602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:57.844644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce9a4-eee6-4da9-8159-b11817b76013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:57.845552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce9a4-eee6-4da9-8159-b11817b76013 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.845839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce9a4-eee6-4da9-8159-b11817b76013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.846120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce9a4-eee6-4da9-8159-b11817b76013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.846918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce9a4-eee6-4da9-8159-b11817b76013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:57.848540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce9a4-eee6-4da9-8159-b11817b76013 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:57.861171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1123/2218] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:45:57.866043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:57.876562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a48cc-0ed3-482c-ad97-8663946ad4e4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:57.882004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:57.885493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.885493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.885493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] PATH_INFO: `/v3/projects/51faed4c5f4d455884ffcca01c885fdc/users/c3c6ab6e720948b9ad6dc0120cab5154/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.885967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51faed4c5f4d455884ffcca01c885fdc, user_id=c3c6ab6e720948b9ad6dc0120cab5154, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:57.888301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:57.898898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1096/2219] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:45:57 2022] PUT /identity/v3/projects/51faed4c5f4d455884ffcca01c885fdc/users/c3c6ab6e720948b9ad6dc0120cab5154/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:57.910849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:57.910849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:57.910849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:57.940834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] MFA Rules not processed for user `c3c6ab6e720948b9ad6dc0120cab5154`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:57.941699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:58.044253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1124/2220] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:58.056350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:58.123232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432ead-d70d-47ec-98eb-23ef0dc4adaf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:58.127143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:58.127896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:58.128250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:58.128597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:58.152942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:58.154835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:58.167408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1097/2221] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:58.335487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:58.337309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:58.352027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7266d8-7d0c-4243-901a-dec5b3a0d581 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:58.355623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de691feb-5b66-47a4-8a63-e613aad0b28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:58.356270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691feb-5b66-47a4-8a63-e613aad0b28a service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:58.356553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691feb-5b66-47a4-8a63-e613aad0b28a service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:58.356862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691feb-5b66-47a4-8a63-e613aad0b28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:58.434350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de691feb-5b66-47a4-8a63-e613aad0b28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:58.436157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de691feb-5b66-47a4-8a63-e613aad0b28a service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:58.449365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1125/2222] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:45:58.681420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:58.752309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:58.901913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:58.969115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffec5-5085-4801-ae82-b6e632e55185 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:58.974466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:58.975333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:58.975618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:58.975900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] PATH_INFO: `/v3/users/d5c21a6cca7b48bd9ce741a16da85eb0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:58.977090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c21a6cca7b48bd9ce741a16da85eb0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:58.979072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:59.266846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c21a6cca7b48bd9ce741a16da85eb0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:59.273527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c21a6cca7b48bd9ce741a16da85eb0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:59.349687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c21a6cca7b48bd9ce741a16da85eb0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:59.364850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c21a6cca7b48bd9ce741a16da85eb0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:59.365789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c21a6cca7b48bd9ce741a16da85eb0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:45:59.372645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1098/2223] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:45:58 2022] DELETE /identity/v3/users/d5c21a6cca7b48bd9ce741a16da85eb0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:45:59.380027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:59.380027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:59.380027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:59.396915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:45:59.398696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:59.460549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1126/2224] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:45:59.470577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:45:59.472530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:45:59.505923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:59.533860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:59.545863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1023c-80f8-44ec-9b6d-760e159f3987 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:45:59.549916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:45:59.550598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:45:59.550881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:45:59.551208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:45:59.560838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:45:59.562608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:45:59.578577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1099/2225] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:45:59.877045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:59.927390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:00.068528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:00.069997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:00.090588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185d2ae-db51-4a35-8921-93a9b9dd7327 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:00.095273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:00.096245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:00.096529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:00.096807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] PATH_INFO: `/v3/projects/a1e4683953e046258b127b58231dda81` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:00.097986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e4683953e046258b127b58231dda81)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:00.100027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:00.155118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:00.207654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e4683953e046258b127b58231dda81', 'request_id': 'req-f8ddece3-8867-4c36-90d5-97bfa93f96b0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.213340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e4683953e046258b127b58231dda81', 'request_id': 'req-f8ddece3-8867-4c36-90d5-97bfa93f96b0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.384202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e4683953e046258b127b58231dda81', 'request_id': 'req-f8ddece3-8867-4c36-90d5-97bfa93f96b0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.396341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] The token cache is being invalidate because project a1e4683953e046258b127b58231dda81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:00.396634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.397296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.398943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1127/2226] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:00 2022] DELETE /identity/v3/projects/a1e4683953e046258b127b58231dda81 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:00.403287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:00.414289 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706f117-fc51-4fe4-a2ec-e6ad07319702 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:00.478151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:00.479112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:00.479434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:00.479714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] PATH_INFO: `/v3/users/c3c6ab6e720948b9ad6dc0120cab5154` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:00.480957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c6ab6e720948b9ad6dc0120cab5154)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:00.482935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:00.655043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c6ab6e720948b9ad6dc0120cab5154'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.663046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c6ab6e720948b9ad6dc0120cab5154'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.732936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c6ab6e720948b9ad6dc0120cab5154'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.750084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c6ab6e720948b9ad6dc0120cab5154'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.750970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ffbb3b07-d6ff-413e-afe2-37245562e554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c6ab6e720948b9ad6dc0120cab5154'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:00.767155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1100/2227] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:00 2022] DELETE /identity/v3/users/c3c6ab6e720948b9ad6dc0120cab5154 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:01.110888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:01.241611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:01.444191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:01.444191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:01.488701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddece3-8867-4c36-90d5-97bfa93f96b0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:01.564218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:01.565165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:01.565996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:01.566307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] PATH_INFO: `/v3/projects/51faed4c5f4d455884ffcca01c885fdc` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:01.567494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51faed4c5f4d455884ffcca01c885fdc)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:01.571986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:01.681083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51faed4c5f4d455884ffcca01c885fdc', 'request_id': 'req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:01.686685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51faed4c5f4d455884ffcca01c885fdc', 'request_id': 'req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:01.687146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:01.773008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51faed4c5f4d455884ffcca01c885fdc', 'request_id': 'req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:01.785109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:01.787885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] The token cache is being invalidate because project 51faed4c5f4d455884ffcca01c885fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:01.787885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:01.787885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-ede10ab9-5340-4d55-a0cc-25a1fb4f0894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:01.789133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1128/2228] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:01 2022] DELETE /identity/v3/projects/51faed4c5f4d455884ffcca01c885fdc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:01.795110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd557-2f38-4456-b037-0800b2096afc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:01.795405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd557-2f38-4456-b037-0800b2096afc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:01.795685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd557-2f38-4456-b037-0800b2096afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:01.841744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b10fd557-2f38-4456-b037-0800b2096afc None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:01.842989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b10fd557-2f38-4456-b037-0800b2096afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:01.902886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1101/2229] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:01.917114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ed130-33f8-4cb2-8c74-3373ee89f873 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:01.917503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ed130-33f8-4cb2-8c74-3373ee89f873 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:01.917879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ed130-33f8-4cb2-8c74-3373ee89f873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:01.940314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-550ed130-33f8-4cb2-8c74-3373ee89f873 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:01.941615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-550ed130-33f8-4cb2-8c74-3373ee89f873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:01.949673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1129/2230] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:01.954026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fd557-2f38-4456-b037-0800b2096afc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:01.963547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fd557-2f38-4456-b037-0800b2096afc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:01.968288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:01.968938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:01.969222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:01.969537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:01.970589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:46:01.970589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:01.977229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:01.984999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1102/2231] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:46:01.989952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ed130-33f8-4cb2-8c74-3373ee89f873 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:01.999339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ed130-33f8-4cb2-8c74-3373ee89f873 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:02.004276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:02.004942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.005214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.005511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.006245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:02.008152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:02.139910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1130/2232] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:46:01 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:46:02.140588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:02.151313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34146a0-6f61-41d4-a7d2-b23c8902ce40 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:02.220271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:02.220969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.221252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.222058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.222796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:02.224818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:02.304540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:02.344566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1103/2233] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:46:02 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:46:02.349330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:02.350066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:02.359482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24fe3-a1fb-45f6-9f63-29f1d7880705 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:02.364775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:02.366023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.366744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.366744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.370614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:02.370614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:02.379675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1131/2234] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:46:02.383854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:02.394709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d40e0-f689-49f3-b6ec-7f3e2df6c666 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:02.399912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5b96-f3ab-4b1e-8844-bf148f57cdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:02.400527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5b96-f3ab-4b1e-8844-bf148f57cdeb admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.400816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5b96-f3ab-4b1e-8844-bf148f57cdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.401099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5b96-f3ab-4b1e-8844-bf148f57cdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.401853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5b96-f3ab-4b1e-8844-bf148f57cdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:02.403622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5b96-f3ab-4b1e-8844-bf148f57cdeb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:02.423574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1104/2235] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:46:02.426679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:02.437134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f16c0f-4ef7-4d8f-92f1-6e50b1ffc286 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:02.442455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:02.443432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.443648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.443923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] PATH_INFO: `/v3/projects/d5a1ee221d7d47209b32ca2b8ec78892/users/664270256a13431985e4af328e38dcee/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.460115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a1ee221d7d47209b32ca2b8ec78892, user_id=664270256a13431985e4af328e38dcee, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:02.462861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:02.628482 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1132/2236] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:46:02 2022] PUT /identity/v3/projects/d5a1ee221d7d47209b32ca2b8ec78892/users/664270256a13431985e4af328e38dcee/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:02.636518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.636518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.636518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.637941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:02.639756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:02.651149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:02.652350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:02.703326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e6cf-7c56-4a49-b09f-5efa8dee8e5f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:02.709550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:02.710464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.710755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.711041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] PATH_INFO: `/v3/users/5cfa38a3f4674280873aa253d5265374` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.712239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfa38a3f4674280873aa253d5265374)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:02.712670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1105/2237] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:02.714397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:02.721909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:02.723321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:02.738649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:02.805061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876f3ea-9589-41f4-9363-30b1718e6e6d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:02.808707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8daf90-a758-4426-9d0a-fc32d70533e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:02.809353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8daf90-a758-4426-9d0a-fc32d70533e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:02.809638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8daf90-a758-4426-9d0a-fc32d70533e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:02.809917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8daf90-a758-4426-9d0a-fc32d70533e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:02.826042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8daf90-a758-4426-9d0a-fc32d70533e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:02.826042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8daf90-a758-4426-9d0a-fc32d70533e3 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:02.832532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1106/2238] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:46:02.858890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:02.952422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfa38a3f4674280873aa253d5265374'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:02.959884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfa38a3f4674280873aa253d5265374'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:02.960544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfa38a3f4674280873aa253d5265374'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:02.961152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfa38a3f4674280873aa253d5265374'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:03.035709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfa38a3f4674280873aa253d5265374'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:03.091610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1133/2239] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:02 2022] DELETE /identity/v3/users/5cfa38a3f4674280873aa253d5265374 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:46:03.096228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:03.096426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:03.096738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:03.142800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:03.142800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:03.236293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:03.244385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1107/2240] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:03.267565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:03.270779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:03.359091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1c7f7-da5a-4516-95d3-e2cc52875c74 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:03.365814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:03.366768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:03.367165 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:03.367584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:03.378554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:03.386491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:03.399528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1134/2241] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:03.681556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:03.930514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:03.932139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:03.948326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8b282-7115-4a67-a34c-c46637bb3d8c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:03.954592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:03.955467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:03.956210 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:03.956495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] PATH_INFO: `/v3/projects/b33bfe410df643c18a9694d48b27e469` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:03.957720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33bfe410df643c18a9694d48b27e469)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:03.959968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:04.105691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33bfe410df643c18a9694d48b27e469', 'request_id': 'req-9a715cb1-5f44-4036-9205-36c86070c38c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.111265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33bfe410df643c18a9694d48b27e469', 'request_id': 'req-9a715cb1-5f44-4036-9205-36c86070c38c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.196404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33bfe410df643c18a9694d48b27e469', 'request_id': 'req-9a715cb1-5f44-4036-9205-36c86070c38c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.210424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] The token cache is being invalidate because project b33bfe410df643c18a9694d48b27e469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:04.211116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.211795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9a715cb1-5f44-4036-9205-36c86070c38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.213422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1108/2242] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:03 2022] DELETE /identity/v3/projects/b33bfe410df643c18a9694d48b27e469 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:04.217330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:04.227216 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb5e2-9b21-44fb-80bb-e9ff7460ebca service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:04.290738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:04.291796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:04.292217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:04.292504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] PATH_INFO: `/v3/users/bff276232f0545eca0e734bdb75e70f6` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:04.293865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff276232f0545eca0e734bdb75e70f6)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:04.296000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:04.513272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff276232f0545eca0e734bdb75e70f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.532184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff276232f0545eca0e734bdb75e70f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.535349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff276232f0545eca0e734bdb75e70f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.536648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff276232f0545eca0e734bdb75e70f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.630943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff276232f0545eca0e734bdb75e70f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:04.663566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:04.664237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:04.664736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:04.716931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1135/2243] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:04 2022] DELETE /identity/v3/users/bff276232f0545eca0e734bdb75e70f6 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:04.727247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] MFA Rules not processed for user `664270256a13431985e4af328e38dcee`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:04.729020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:04.829917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1109/2244] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:04.840639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:04.842103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:04.900418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c53f03-3838-489d-8733-c329a2622a8f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:04.904083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:04.904728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:04.905015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:04.905296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:04.914327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:04.915751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:04.937854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1136/2245] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:05.365744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:05.365744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:05.434429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183b72-723c-4b85-b8b1-a48256c62ed4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:05.436984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:05.437826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:05.438109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:05.438419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] PATH_INFO: `/v3/projects/4bf31e3da09a4684b7ddae610cbfe05b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:05.439587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf31e3da09a4684b7ddae610cbfe05b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:05.441479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:05.487768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:05.555984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf31e3da09a4684b7ddae610cbfe05b', 'request_id': 'req-6136cd82-3286-4e76-8040-804aed5a16c3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:05.561920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf31e3da09a4684b7ddae610cbfe05b', 'request_id': 'req-6136cd82-3286-4e76-8040-804aed5a16c3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:05.672355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf31e3da09a4684b7ddae610cbfe05b', 'request_id': 'req-6136cd82-3286-4e76-8040-804aed5a16c3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:05.686164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] The token cache is being invalidate because project 4bf31e3da09a4684b7ddae610cbfe05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:05.686727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:05.687399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:05.689298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1110/2246] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:05 2022] DELETE /identity/v3/projects/4bf31e3da09a4684b7ddae610cbfe05b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:05.695127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:05.711397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a2c5-de74-4436-ae76-4f870933fcf1 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:05.807439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:05.808703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:05.809231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:05.809734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] PATH_INFO: `/v3/users/c4c818fbad504180a168848f988c67a2` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:05.811242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c818fbad504180a168848f988c67a2)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:05.813795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:06.011507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c818fbad504180a168848f988c67a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.018845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c818fbad504180a168848f988c67a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.019677 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c818fbad504180a168848f988c67a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.020272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c818fbad504180a168848f988c67a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.148902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8f2b71-34ff-4204-ae06-3eb16365b96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c818fbad504180a168848f988c67a2'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.168720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1137/2247] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:05 2022] DELETE /identity/v3/users/c4c818fbad504180a168848f988c67a2 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:06.389991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:06.644530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:06.644530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:06.658083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136cd82-3286-4e76-8040-804aed5a16c3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:06.718865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:06.719862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:06.720144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:06.720420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] PATH_INFO: `/v3/projects/20230012ac7c4a449844bae62983132f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:06.721651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20230012ac7c4a449844bae62983132f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:06.723602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:06.736459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5d25-72af-4fa3-a029-dcb52dd4ffeb None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:06.736991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5d25-72af-4fa3-a029-dcb52dd4ffeb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:06.737084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5d25-72af-4fa3-a029-dcb52dd4ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:06.762559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-75af5d25-72af-4fa3-a029-dcb52dd4ffeb None None] MFA Rules not processed for user `664270256a13431985e4af328e38dcee`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:06.763791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-75af5d25-72af-4fa3-a029-dcb52dd4ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:06.855034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1138/2248] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:06.875089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20230012ac7c4a449844bae62983132f', 'request_id': 'req-85147065-b87c-4f10-b3a2-2f2f6df381a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.882262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20230012ac7c4a449844bae62983132f', 'request_id': 'req-85147065-b87c-4f10-b3a2-2f2f6df381a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.978681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20230012ac7c4a449844bae62983132f', 'request_id': 'req-85147065-b87c-4f10-b3a2-2f2f6df381a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.991844 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] The token cache is being invalidate because project 20230012ac7c4a449844bae62983132f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:06.992339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.993097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-85147065-b87c-4f10-b3a2-2f2f6df381a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:06.999776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1111/2249] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:06 2022] DELETE /identity/v3/projects/20230012ac7c4a449844bae62983132f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:07.003530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0dd7-c7d9-41d1-ac78-1d27e71a9cb0 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.003915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0dd7-c7d9-41d1-ac78-1d27e71a9cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.004296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0dd7-c7d9-41d1-ac78-1d27e71a9cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.026273 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ee1e0dd7-c7d9-41d1-ac78-1d27e71a9cb0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:07.027942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ee1e0dd7-c7d9-41d1-ac78-1d27e71a9cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:07.098373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1139/2250] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:07.106005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b69be-d7fa-4185-8856-e6b63ec6d410 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.106324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b69be-d7fa-4185-8856-e6b63ec6d410 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.106610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b69be-d7fa-4185-8856-e6b63ec6d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.125824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-903b69be-d7fa-4185-8856-e6b63ec6d410 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:07.127098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-903b69be-d7fa-4185-8856-e6b63ec6d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:07.135253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1112/2251] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:07.139335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0dd7-c7d9-41d1-ac78-1d27e71a9cb0 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:07.149308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0dd7-c7d9-41d1-ac78-1d27e71a9cb0 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:07.153954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:07.154562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.154847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.162585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.162585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:46:07.162585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:07.162585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:07.173418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1140/2252] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:46:07.174483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b69be-d7fa-4185-8856-e6b63ec6d410 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:07.185230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b69be-d7fa-4185-8856-e6b63ec6d410 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:07.190719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:07.192075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.192500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.192949 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.193649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:07.195616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:07.332411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1113/2253] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:46:07 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:46:07.333644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:07.343798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c53d3-9ff6-4bfc-9995-c99ab297ecc2 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:07.409670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:07.410408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.410747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.412207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.412923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:07.415411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:07.510949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1141/2254] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:46:07 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:46:07.515087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:07.526994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9b183-bce7-43c5-95a4-b09d117f6a43 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:07.531708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:07.532374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.532662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.532943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.534085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:07.535726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:07.547740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1114/2255] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:46:07.552618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:07.563657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48413a54-a4f1-40d0-99dd-644298e26c67 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:07.568942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea6aaa-ef1e-4b2f-8b9b-4f6aa741a912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:07.569586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6aaa-ef1e-4b2f-8b9b-4f6aa741a912 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.569877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6aaa-ef1e-4b2f-8b9b-4f6aa741a912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.570149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6aaa-ef1e-4b2f-8b9b-4f6aa741a912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.570964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea6aaa-ef1e-4b2f-8b9b-4f6aa741a912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:07.572683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea6aaa-ef1e-4b2f-8b9b-4f6aa741a912 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:07.583224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1142/2256] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:46:07.587707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:07.597612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ebdc1-f564-447e-b5b1-2787d0e8bc50 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:07.602595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:07.603525 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.603809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.604085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] PATH_INFO: `/v3/projects/e78c79099f3a4eefb4719b8e5af60f96/users/2d2291ab7e2f4e798d04317d2507ff3f/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.626621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78c79099f3a4eefb4719b8e5af60f96, user_id=2d2291ab7e2f4e798d04317d2507ff3f, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:07.630108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:07.724552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1115/2257] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:46:07 2022] PUT /identity/v3/projects/e78c79099f3a4eefb4719b8e5af60f96/users/2d2291ab7e2f4e798d04317d2507ff3f/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:07.737863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:07.738425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:07.738520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:07.772492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] MFA Rules not processed for user `2d2291ab7e2f4e798d04317d2507ff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:07.773710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:07.888278 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1143/2258] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:07.904524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:07.907620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:08.006905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f2ad6-661a-4c3a-8c6e-ea2bb188a378 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:08.011142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df13efc-696b-4164-93d7-e5046ea237ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:08.011983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13efc-696b-4164-93d7-e5046ea237ab service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:08.012434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13efc-696b-4164-93d7-e5046ea237ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:08.012779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13efc-696b-4164-93d7-e5046ea237ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:08.020178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:08.023790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df13efc-696b-4164-93d7-e5046ea237ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:08.025621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df13efc-696b-4164-93d7-e5046ea237ab service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:08.038457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1116/2259] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:08.148954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:09.825161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:10.207763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:10.550243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:11.291056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:11.295603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:11.359973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e9b5-e31e-4450-a19c-04726a13f347 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:11.365537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:11.366648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:11.366939 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:11.367220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] PATH_INFO: `/v3/users/715c689014c44bdfb346bdff4d1b4458` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:11.368450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] RBAC: Authorizing `identity:delete_user(user_id=715c689014c44bdfb346bdff4d1b4458)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:11.370493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:11.619484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715c689014c44bdfb346bdff4d1b4458'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:11.628146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715c689014c44bdfb346bdff4d1b4458'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:11.629467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715c689014c44bdfb346bdff4d1b4458'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:11.630139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715c689014c44bdfb346bdff4d1b4458'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:11.739181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715c689014c44bdfb346bdff4d1b4458'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:11.777279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1144/2260] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:11 2022] DELETE /identity/v3/users/715c689014c44bdfb346bdff4d1b4458 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:11.783428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:11.795536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:11.795536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:11.811850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:11.813941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:11.930914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1117/2261] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:11.942601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:11.945107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:12.011485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308719a-b3d8-4400-acb4-9121b3f0138a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:12.016720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cada00-a03a-4321-ace9-2603dfa49fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:12.017463 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cada00-a03a-4321-ace9-2603dfa49fce service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:12.017773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cada00-a03a-4321-ace9-2603dfa49fce service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:12.018048 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cada00-a03a-4321-ace9-2603dfa49fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:12.028642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cada00-a03a-4321-ace9-2603dfa49fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:12.030160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cada00-a03a-4321-ace9-2603dfa49fce service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:12.040756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1145/2262] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:12.116097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:12.532473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:12.534162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:12.546334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887a788-d5b2-442b-aa62-ab2ed5a3f3c0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:12.551483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:12.552342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:12.552634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:12.552913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] PATH_INFO: `/v3/projects/b1d4092319204b878a7b58b7c31d736d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:12.554146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d4092319204b878a7b58b7c31d736d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:12.556104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:12.670316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d4092319204b878a7b58b7c31d736d', 'request_id': 'req-15649f04-2a34-45f7-b4cc-b72f6aab23d8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:12.675822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d4092319204b878a7b58b7c31d736d', 'request_id': 'req-15649f04-2a34-45f7-b4cc-b72f6aab23d8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:12.681463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:12.743999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d4092319204b878a7b58b7c31d736d', 'request_id': 'req-15649f04-2a34-45f7-b4cc-b72f6aab23d8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:12.755884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] The token cache is being invalidate because project b1d4092319204b878a7b58b7c31d736d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:12.756208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:12.756838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:12.758484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1118/2263] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:12 2022] DELETE /identity/v3/projects/b1d4092319204b878a7b58b7c31d736d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:13.807462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:13.852753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:14.608546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:14.635937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:15.530712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c005-cbc7-4602-b8e4-7778480f84b2 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:15.532299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c005-cbc7-4602-b8e4-7778480f84b2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:15.532737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c005-cbc7-4602-b8e4-7778480f84b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:15.568867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e758c005-cbc7-4602-b8e4-7778480f84b2 None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:15.571287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e758c005-cbc7-4602-b8e4-7778480f84b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:15.658534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1146/2264] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:15.721367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:15.723784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:15.796463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:15.823478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649f04-2a34-45f7-b4cc-b72f6aab23d8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:15.829782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:15.830605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:15.831065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:15.832005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:15.851975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:15.854570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:15.874529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1119/2265] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 21:46:15.916806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:16.594777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:16.728007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:16.913052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:16.980873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d41ac-c574-4281-952a-3f815e4f415a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:16.981173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d41ac-c574-4281-952a-3f815e4f415a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:16.981459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d41ac-c574-4281-952a-3f815e4f415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:16.999126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-2d0d41ac-c574-4281-952a-3f815e4f415a None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:17.000404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2d0d41ac-c574-4281-952a-3f815e4f415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:17.008624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1147/2266] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 19 21:46:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:17.022448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:17.033054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ae66b-3e9c-4d9f-9ac8-a01e8349caf2 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:17.035952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:17.039352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:17.040085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:17.040371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:17.040649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:17.052908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:17.053910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:17.064468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1120/2267] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:46:17.459159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:17.656298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a45c7-b182-4491-9054-9d8070ec0be6 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:17.656608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a45c7-b182-4491-9054-9d8070ec0be6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:17.656882 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a45c7-b182-4491-9054-9d8070ec0be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:17.674932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-d15a45c7-b182-4491-9054-9d8070ec0be6 None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:17.676688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d15a45c7-b182-4491-9054-9d8070ec0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:17.684065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1148/2268] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:17.696586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:17.708678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e448b-35c8-48cf-8719-2fdfac4cd802 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:17.717715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:17.717715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:17.717715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:17.717715 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:17.726307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:17.728009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:17.736505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1121/2269] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:46:17.961899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:18.362538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c5f5c-5891-4372-922e-1c1022428288 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:18.363023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c5f5c-5891-4372-922e-1c1022428288 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:18.363703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c5f5c-5891-4372-922e-1c1022428288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:18.382395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-313c5f5c-5891-4372-922e-1c1022428288 None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:18.383638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-313c5f5c-5891-4372-922e-1c1022428288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:18.391928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1149/2270] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 19 21:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:18.411878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:18.424167 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fc936-30ed-4d3a-9e47-e32052d0cee3 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:18.433565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:18.434251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:18.434539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:18.435211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:18.447062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:18.449305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:18.460626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1122/2271] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:46:19.313613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838636-a450-4bc4-a6dc-41560d38a246 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:19.314468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838636-a450-4bc4-a6dc-41560d38a246 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:19.314917 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838636-a450-4bc4-a6dc-41560d38a246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:19.356038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9f838636-a450-4bc4-a6dc-41560d38a246 None None] MFA Rules not processed for user `bafd0e09a6134be080a352b63d867356`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:19.356038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9f838636-a450-4bc4-a6dc-41560d38a246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:19.428595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1150/2272] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:20.170548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:20.172222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:20.266724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed97290-4862-44ed-812b-414d95c41e9f service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:20.272540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:20.273504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:20.273962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:20.274432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] PATH_INFO: `/v3/users/2d2291ab7e2f4e798d04317d2507ff3f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:20.282175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2291ab7e2f4e798d04317d2507ff3f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:20.282175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:20.546398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2291ab7e2f4e798d04317d2507ff3f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:20.554082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2291ab7e2f4e798d04317d2507ff3f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:20.629382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2291ab7e2f4e798d04317d2507ff3f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:20.646234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2291ab7e2f4e798d04317d2507ff3f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:20.647021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2291ab7e2f4e798d04317d2507ff3f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:20.653290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1123/2273] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:20 2022] DELETE /identity/v3/users/2d2291ab7e2f4e798d04317d2507ff3f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:20.657959 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:20.658746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:20.658838 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:20.676190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:20.677436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:20.738418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1151/2274] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:20.748224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:20.749767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:20.781470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:20.818119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2481-a3b7-4804-9b5b-f2132b11c836 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:20.821705 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d564593-2f8f-4fc8-b586-3a780cd6c88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:20.822376 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564593-2f8f-4fc8-b586-3a780cd6c88c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:20.822659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564593-2f8f-4fc8-b586-3a780cd6c88c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:20.822931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564593-2f8f-4fc8-b586-3a780cd6c88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:20.832304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d564593-2f8f-4fc8-b586-3a780cd6c88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:20.833721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d564593-2f8f-4fc8-b586-3a780cd6c88c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:20.843294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1124/2275] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:21.274141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:21.275676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:21.295549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45d782-fcc0-4693-89b7-8fc8080faa5c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:21.302786 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:21.303866 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:21.304478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:21.304919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] PATH_INFO: `/v3/projects/e78c79099f3a4eefb4719b8e5af60f96` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:21.307120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78c79099f3a4eefb4719b8e5af60f96)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:21.309252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:21.426883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78c79099f3a4eefb4719b8e5af60f96', 'request_id': 'req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.432770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78c79099f3a4eefb4719b8e5af60f96', 'request_id': 'req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.481533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78c79099f3a4eefb4719b8e5af60f96', 'request_id': 'req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.490636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:21.495980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] The token cache is being invalidate because project e78c79099f3a4eefb4719b8e5af60f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:21.496253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.497117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.500099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1152/2276] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:21 2022] DELETE /identity/v3/projects/e78c79099f3a4eefb4719b8e5af60f96 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:21.507731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bcda6-45c7-4f43-b648-e98f0db9f716 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:21.508223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bcda6-45c7-4f43-b648-e98f0db9f716 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:21.509972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bcda6-45c7-4f43-b648-e98f0db9f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:21.544923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-235bcda6-45c7-4f43-b648-e98f0db9f716 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:21.546550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-235bcda6-45c7-4f43-b648-e98f0db9f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:21.561376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:21.561376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:21.638019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d693ac-e78e-4b5f-b8b1-d92be8cf691f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:21.644940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:21.645822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:21.646115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:21.649600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1125/2277] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:21.649790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] PATH_INFO: `/v3/users/b538cbd70f72473fabee18d02c324b1e` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:21.649790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b538cbd70f72473fabee18d02c324b1e)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:21.649790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:21.651601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bffc3-8b24-462a-b039-b785f2b2456d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:21.652672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bffc3-8b24-462a-b039-b785f2b2456d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:21.652958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bffc3-8b24-462a-b039-b785f2b2456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:21.679633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-662bffc3-8b24-462a-b039-b785f2b2456d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:21.680933 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-662bffc3-8b24-462a-b039-b785f2b2456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:21.689558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1126/2278] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:21.694166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bffc3-8b24-462a-b039-b785f2b2456d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:21.704123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bffc3-8b24-462a-b039-b785f2b2456d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:21.712311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:21.713031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:21.713484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:21.713916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:21.714871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:46:21.715342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:21.717091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:21.732811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1127/2279] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:46:21.738550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:21.757193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f017b-9c82-47d8-99c2-87daa053cec7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:21.763798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:21.765056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:21.765536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:21.765823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:21.766596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:21.768581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:21.949864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1128/2280] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:46:21 2022] POST /identity/v3/projects => generated 399 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:46:21.951074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:21.954814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b538cbd70f72473fabee18d02c324b1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.961661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b538cbd70f72473fabee18d02c324b1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.962353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b538cbd70f72473fabee18d02c324b1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:21.962957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b538cbd70f72473fabee18d02c324b1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:22.024931 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2737-97a3-4c02-8ca2-54a51c5826ff admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:22.030014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:22.030712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.031002 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.031279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.031964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:22.034150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:22.046927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4ec412cf-ec5e-4ddf-84c4-c858c78dad74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b538cbd70f72473fabee18d02c324b1e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:22.064827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1153/2281] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:21 2022] DELETE /identity/v3/users/b538cbd70f72473fabee18d02c324b1e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:22.069943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.070448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.070737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.087741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:22.088974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:22.116964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1129/2282] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:46:21 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:46:22.120826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:22.122620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:22.131792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:22.135988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75abed-5e89-45f1-bcc4-781c51d12e75 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:22.149316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1154/2283] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:22.160106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:22.161540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:22.191055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:22.202110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:22.202940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.203365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.203875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.204693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:22.206663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:22.218158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1130/2284] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:46:22.222602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:22.233423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fc39-a623-411b-9fa1-501224515b71 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:22.234888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2a4a-5389-40db-8cc7-9a6ee31ff9ab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:22.239170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc9977-d557-4596-945f-ea5f57fa538a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:22.240105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:22.240245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9977-d557-4596-945f-ea5f57fa538a service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.240245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9977-d557-4596-945f-ea5f57fa538a service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.240429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.240515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.240606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9977-d557-4596-945f-ea5f57fa538a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.240776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.241483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:22.243120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:22.253720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc9977-d557-4596-945f-ea5f57fa538a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:22.255059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1131/2285] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:46:22.255186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc9977-d557-4596-945f-ea5f57fa538a service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:22.258692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:22.267283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1155/2286] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:46:22.273602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3778-5409-4cfe-91c7-35814d5a8002 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:22.280183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:22.281149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.282343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.282451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] PATH_INFO: `/v3/projects/487c904008d94f3b9cbae3570fd66ae2/users/3071d4fb36a443e584ef434b6c820d6f/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.309378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487c904008d94f3b9cbae3570fd66ae2, user_id=3071d4fb36a443e584ef434b6c820d6f, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:22.312023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:22.408071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1132/2287] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:46:22 2022] PUT /identity/v3/projects/487c904008d94f3b9cbae3570fd66ae2/users/3071d4fb36a443e584ef434b6c820d6f/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:46:22.418687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.419053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.419409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.446709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] MFA Rules not processed for user `3071d4fb36a443e584ef434b6c820d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:22.447922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:22.514471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1156/2288] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:22.523711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:22.525497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:22.526732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:22.528207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:22.607901 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fec2e-2cf2-46aa-ba28-23f3bdead9c4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:22.608871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb0532-1e44-4483-b65f-223a8a1a3297 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:22.612865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:22.613236 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a9baa-51ee-48ec-9cf9-2f4d18e85037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:22.613920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.614057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9baa-51ee-48ec-9cf9-2f4d18e85037 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.614245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.614365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9baa-51ee-48ec-9cf9-2f4d18e85037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.614506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] PATH_INFO: `/v3/projects/b7db5e527d1940c7b1326950aa4655c0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.614601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9baa-51ee-48ec-9cf9-2f4d18e85037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.615908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7db5e527d1940c7b1326950aa4655c0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:22.618075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:22.624402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9baa-51ee-48ec-9cf9-2f4d18e85037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:22.625942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9baa-51ee-48ec-9cf9-2f4d18e85037 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:22.635877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1157/2289] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:22.725316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7db5e527d1940c7b1326950aa4655c0', 'request_id': 'req-f652e930-f912-4b35-a9f8-5f03634bdbee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:22.738610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7db5e527d1940c7b1326950aa4655c0', 'request_id': 'req-f652e930-f912-4b35-a9f8-5f03634bdbee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:22.801280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7db5e527d1940c7b1326950aa4655c0', 'request_id': 'req-f652e930-f912-4b35-a9f8-5f03634bdbee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:22.803563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:22.813464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] The token cache is being invalidate because project b7db5e527d1940c7b1326950aa4655c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:22.813761 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:22.814463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f652e930-f912-4b35-a9f8-5f03634bdbee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:22.816333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1133/2290] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:22 2022] DELETE /identity/v3/projects/b7db5e527d1940c7b1326950aa4655c0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:22.821043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698143-a03d-46dc-aab0-e56afa35d16f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.821335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698143-a03d-46dc-aab0-e56afa35d16f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.821615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698143-a03d-46dc-aab0-e56afa35d16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:22.842395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-49698143-a03d-46dc-aab0-e56afa35d16f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:22.844210 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-49698143-a03d-46dc-aab0-e56afa35d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:22.920309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:22.943126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1158/2291] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:22.953550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfed32-ba28-4bd0-9c70-906be50f08d0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:22.954108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfed32-ba28-4bd0-9c70-906be50f08d0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:22.954532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfed32-ba28-4bd0-9c70-906be50f08d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.003945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0adfed32-ba28-4bd0-9c70-906be50f08d0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:23.005382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0adfed32-ba28-4bd0-9c70-906be50f08d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:23.024053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1134/2292] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:23.025117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49698143-a03d-46dc-aab0-e56afa35d16f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:23.040201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49698143-a03d-46dc-aab0-e56afa35d16f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:23.049221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:23.050111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.051069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.051069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.055530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:46:23.055530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:23.063223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:23.084823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1159/2293] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:46:23.087509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfed32-ba28-4bd0-9c70-906be50f08d0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:23.105242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfed32-ba28-4bd0-9c70-906be50f08d0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:23.112742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:23.112742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.112742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.112742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.113098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:23.114457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:23.203156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1135/2294] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:46:23 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:46:23.207756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:23.218023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b7ca4-2cd2-4aac-82c0-33cc905ad3f5 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:23.278441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:23.279049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.279339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.279617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.280335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:23.282287 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:23.358506 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1160/2295] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:46:23 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:46:23.360639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:23.371995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c1c3-a06f-4cab-bfb9-81206ff0f44b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:23.377659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:23.387247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.387247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.387247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.387247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:23.387247 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:23.392935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1136/2296] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:46:23.396860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:23.406798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5630d-fdb9-450c-926c-7cdd6b9de31d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:23.411726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89e567-4057-4e66-af24-3fe0787eddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:23.412443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e567-4057-4e66-af24-3fe0787eddd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.414057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e567-4057-4e66-af24-3fe0787eddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.414057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e567-4057-4e66-af24-3fe0787eddd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.414057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89e567-4057-4e66-af24-3fe0787eddd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:23.415344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89e567-4057-4e66-af24-3fe0787eddd9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:23.427015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1161/2297] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:46:23.431170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:23.442102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba03b-62ec-4bd1-8f4a-0f902fd05c26 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:23.447096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:23.448049 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.448261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.448538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] PATH_INFO: `/v3/projects/95a4aa19704f4d82beafc721d1027595/users/fe070638c83241d0a770a549b4517223/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.466163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a4aa19704f4d82beafc721d1027595, user_id=fe070638c83241d0a770a549b4517223, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:23.469603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:23.557517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1137/2298] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:46:23 2022] PUT /identity/v3/projects/95a4aa19704f4d82beafc721d1027595/users/fe070638c83241d0a770a549b4517223/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:23.563330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04078-1d04-47b8-83e7-dcf3cc55c915 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.564394 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04078-1d04-47b8-83e7-dcf3cc55c915 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.564698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04078-1d04-47b8-83e7-dcf3cc55c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.584451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8aa04078-1d04-47b8-83e7-dcf3cc55c915 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:23.585650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8aa04078-1d04-47b8-83e7-dcf3cc55c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:23.653125 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1162/2299] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:23.667169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:23.669396 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:23.737355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27146-a152-41af-be6f-7baee87ca7fb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:23.741972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:23.742887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:23.743190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:23.743473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:23.754450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:23.755977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:23.766453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1138/2300] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:25.479157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3b9eb-3387-4189-b654-51596e4a98ef None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:25.479775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3b9eb-3387-4189-b654-51596e4a98ef None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:25.480049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3b9eb-3387-4189-b654-51596e4a98ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:25.515353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a7d3b9eb-3387-4189-b654-51596e4a98ef None None] MFA Rules not processed for user `fe070638c83241d0a770a549b4517223`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:25.520446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a7d3b9eb-3387-4189-b654-51596e4a98ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:25.573075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:25.596348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1163/2301] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:25.612311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:25.613873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:25.684138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504e361-3e39-48f0-a351-1e47d7175600 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:25.688638 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:25.689303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:25.689744 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:25.690166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:25.700913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:25.702508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:25.717128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1139/2302] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:27.538094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecd90d-7bcd-4cd0-b839-c713fb7bdf2c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:27.539016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecd90d-7bcd-4cd0-b839-c713fb7bdf2c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:27.539651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecd90d-7bcd-4cd0-b839-c713fb7bdf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:27.571815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0cecd90d-7bcd-4cd0-b839-c713fb7bdf2c None None] MFA Rules not processed for user `fe070638c83241d0a770a549b4517223`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:27.573054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0cecd90d-7bcd-4cd0-b839-c713fb7bdf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:27.580371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1164/2303] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:29.980604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:29.982111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:29.997701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b2c2e-fccc-4bfb-856b-3929067a782b service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:30.002930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:30.003802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:30.004090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:30.004370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] PATH_INFO: `/v3/users/3071d4fb36a443e584ef434b6c820d6f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:30.005636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3071d4fb36a443e584ef434b6c820d6f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:30.007615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:30.157426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:30.172110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3071d4fb36a443e584ef434b6c820d6f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:30.179508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3071d4fb36a443e584ef434b6c820d6f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:30.247021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3071d4fb36a443e584ef434b6c820d6f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:30.259813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3071d4fb36a443e584ef434b6c820d6f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:30.260501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3071d4fb36a443e584ef434b6c820d6f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:30.266394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1140/2304] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:46:29 2022] DELETE /identity/v3/users/3071d4fb36a443e584ef434b6c820d6f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:30.271518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:30.271989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:30.272101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:30.290560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:30.291768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:30.356049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1165/2305] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:30.364630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:30.366637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:30.476668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a6c9-0679-4172-916c-7a0b29c3ccfe admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:30.484818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d717819-2cce-4818-8c81-7f9736860aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:30.485962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717819-2cce-4818-8c81-7f9736860aba service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:30.486527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717819-2cce-4818-8c81-7f9736860aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:30.487749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717819-2cce-4818-8c81-7f9736860aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:30.504310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d717819-2cce-4818-8c81-7f9736860aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:30.506873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d717819-2cce-4818-8c81-7f9736860aba service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:30.523545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1141/2306] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:31.031414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:31.032773 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:31.059084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39762f3a-ad44-4a87-b845-be572a0f2707 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:31.064568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:31.067929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:31.067929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:31.067929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] PATH_INFO: `/v3/projects/487c904008d94f3b9cbae3570fd66ae2` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:31.068367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] RBAC: Authorizing `identity:delete_project(project_id=487c904008d94f3b9cbae3570fd66ae2)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:31.070971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:31.180700 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:31.181160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:31.181334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:31.212893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] MFA Rules not processed for user `664270256a13431985e4af328e38dcee`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:31.215484 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:31.254262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487c904008d94f3b9cbae3570fd66ae2', 'request_id': 'req-fc595f53-f2b6-426e-b947-adccf570190f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:31.264171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487c904008d94f3b9cbae3570fd66ae2', 'request_id': 'req-fc595f53-f2b6-426e-b947-adccf570190f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:31.338924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487c904008d94f3b9cbae3570fd66ae2', 'request_id': 'req-fc595f53-f2b6-426e-b947-adccf570190f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:31.368079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] The token cache is being invalidate because project 487c904008d94f3b9cbae3570fd66ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:46:31.370534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:31.370534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fc595f53-f2b6-426e-b947-adccf570190f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:46:31.377347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1166/2307] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:46:31 2022] DELETE /identity/v3/projects/487c904008d94f3b9cbae3570fd66ae2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:46:31.435215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1142/2308] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:31.923101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c411-8a70-4ce1-8688-eeeee1c480be None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:31.923390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c411-8a70-4ce1-8688-eeeee1c480be None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:31.923845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c411-8a70-4ce1-8688-eeeee1c480be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:31.951156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ff09c411-8a70-4ce1-8688-eeeee1c480be None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:31.952279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ff09c411-8a70-4ce1-8688-eeeee1c480be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:32.041637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1167/2309] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:32.055303 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:32.062950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:32.137241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:32.152102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279150d-1abc-42fb-b2e9-b8724ddcde9d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:32.216938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f471-3070-4c1c-be48-2e00763a14ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:32.217658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f471-3070-4c1c-be48-2e00763a14ab service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:32.217948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f471-3070-4c1c-be48-2e00763a14ab service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:32.218319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f471-3070-4c1c-be48-2e00763a14ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:32.227487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190f471-3070-4c1c-be48-2e00763a14ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:32.229375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190f471-3070-4c1c-be48-2e00763a14ab service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:32.242469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1143/2310] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:46:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 21:46:42.030666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:42.903886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=32 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:51.199009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab225a-a928-482d-ba54-a01226f4867a None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.199528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab225a-a928-482d-ba54-a01226f4867a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.203660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab225a-a928-482d-ba54-a01226f4867a None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.203660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1168/2311] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:46:51.208053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755268-aa1b-400e-b539-cf31ddbbf205 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.208913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755268-aa1b-400e-b539-cf31ddbbf205 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.209558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755268-aa1b-400e-b539-cf31ddbbf205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.268974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dc755268-aa1b-400e-b539-cf31ddbbf205 None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:51.270425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dc755268-aa1b-400e-b539-cf31ddbbf205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:51.352589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1144/2312] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:51.365090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab225a-a928-482d-ba54-a01226f4867a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:51.366913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-69ab225a-a928-482d-ba54-a01226f4867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:51.450267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab225a-a928-482d-ba54-a01226f4867a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:51.453753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0e313-785d-4924-97bf-e0654082e16b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:51.454446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e313-785d-4924-97bf-e0654082e16b service glance] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.454742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e313-785d-4924-97bf-e0654082e16b service glance] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.455022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e313-785d-4924-97bf-e0654082e16b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.465481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0e313-785d-4924-97bf-e0654082e16b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:51.466954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0e313-785d-4924-97bf-e0654082e16b service glance] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:51.477976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1169/2313] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:51.705424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34279229-7d61-4be1-a7bc-63f5ed6f71ca None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.705679 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34279229-7d61-4be1-a7bc-63f5ed6f71ca None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.705968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34279229-7d61-4be1-a7bc-63f5ed6f71ca None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.707457 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1145/2314] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:46:51.712291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b216e-5639-4373-a597-ef9b1da8c8be None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.715172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b216e-5639-4373-a597-ef9b1da8c8be None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.715172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b216e-5639-4373-a597-ef9b1da8c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.737557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-bf0b216e-5639-4373-a597-ef9b1da8c8be None None] MFA Rules not processed for user `40b920b115454a708a14a62ead99eccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:51.738795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-bf0b216e-5639-4373-a597-ef9b1da8c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:51.792504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1170/2315] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:51.804058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34279229-7d61-4be1-a7bc-63f5ed6f71ca None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:51.807079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-34279229-7d61-4be1-a7bc-63f5ed6f71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:51.819538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34279229-7d61-4be1-a7bc-63f5ed6f71ca None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:51.823448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c982094-145f-40a2-bd78-8cbbf41eec43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:51.824107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c982094-145f-40a2-bd78-8cbbf41eec43 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.824391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c982094-145f-40a2-bd78-8cbbf41eec43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.824668 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c982094-145f-40a2-bd78-8cbbf41eec43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.833021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c982094-145f-40a2-bd78-8cbbf41eec43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:51.834494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c982094-145f-40a2-bd78-8cbbf41eec43 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:51.846909 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1146/2316] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:51.929810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925022-e2a2-4e3b-91a3-686606f69341 None None] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.930103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925022-e2a2-4e3b-91a3-686606f69341 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.930438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925022-e2a2-4e3b-91a3-686606f69341 None None] PATH_INFO: `/` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.932075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1171/2317] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 19 21:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:46:51.937501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d9bf-ae4d-4fa6-af84-4a5cb4fd772e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.937914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d9bf-ae4d-4fa6-af84-4a5cb4fd772e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.938356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d9bf-ae4d-4fa6-af84-4a5cb4fd772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:51.957206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4326d9bf-ae4d-4fa6-af84-4a5cb4fd772e None None] MFA Rules not processed for user `37df82be35a448bf819e4f157741b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:51.958338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4326d9bf-ae4d-4fa6-af84-4a5cb4fd772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:51.967510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1147/2318] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 19 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:46:51.978201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4925022-e2a2-4e3b-91a3-686606f69341 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:51.990463 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4925022-e2a2-4e3b-91a3-686606f69341 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:51.994124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:51.994801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:51.995089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:51.995371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:52.005985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:52.007462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:52.018006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1172/2319] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:46:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:46:55.659507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6d3a-cc45-44e8-ba56-8fdf7899ce76 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:55.659983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6d3a-cc45-44e8-ba56-8fdf7899ce76 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:55.660125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6d3a-cc45-44e8-ba56-8fdf7899ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:55.708411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0f1a6d3a-cc45-44e8-ba56-8fdf7899ce76 None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:55.709690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0f1a6d3a-cc45-44e8-ba56-8fdf7899ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:55.727768 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1148/2320] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:46:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:55.740371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:55.762636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac76509-6fe5-43be-96fe-0f172151a4a3 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:55.767592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:55.768256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:55.768540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:55.768818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:55.777561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:55.779175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:55.788300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1173/2321] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:46:57.962345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02825245-08d7-49e6-88fa-c5ddb4428249 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:57.962345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02825245-08d7-49e6-88fa-c5ddb4428249 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:57.962345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02825245-08d7-49e6-88fa-c5ddb4428249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:57.962345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-02825245-08d7-49e6-88fa-c5ddb4428249 None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:46:57.962345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-02825245-08d7-49e6-88fa-c5ddb4428249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:46:57.980862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1149/2322] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:46:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:46:58.007191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:46:58.019489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc51a8-069f-4380-bf99-95f519642385 service swift] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:46:58.024790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:46:58.025453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:46:58.025742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:46:58.026025 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:46:58.036060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:46:58.037667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:46:58.046586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1174/2323] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:47:07.953183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=76 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:08.043003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=80 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:13.661779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189deba-616d-43df-923a-e0e57bd62cd5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:13.662508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189deba-616d-43df-923a-e0e57bd62cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:13.662508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189deba-616d-43df-923a-e0e57bd62cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:13.681478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b189deba-616d-43df-923a-e0e57bd62cd5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:13.682979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b189deba-616d-43df-923a-e0e57bd62cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:13.748312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1150/2324] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:13.765457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:13.767164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:13.784987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7668ce-3ffc-45cb-9472-e2123634e303 service swift] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:13.792334 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:13.792993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:13.793282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:13.793563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:13.804085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:13.805836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:13.816984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1175/2325] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:15.320287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035add-4fcf-413a-b824-6092b25ca7ed None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:15.320753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035add-4fcf-413a-b824-6092b25ca7ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:15.320851 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035add-4fcf-413a-b824-6092b25ca7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:15.339427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-69035add-4fcf-413a-b824-6092b25ca7ed None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:15.345754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-69035add-4fcf-413a-b824-6092b25ca7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:15.347597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1151/2326] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 19 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:15.359897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:15.371206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81670a48-58b3-4c37-9289-4528cc5c0920 service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:15.376109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:15.376740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:15.377026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:15.377312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:15.385783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:15.387391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:15.395953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1176/2327] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:47:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:47:17.547256 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39785ac-6c6f-4be3-8ad3-9106a518254a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:17.547777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39785ac-6c6f-4be3-8ad3-9106a518254a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:17.547935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39785ac-6c6f-4be3-8ad3-9106a518254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:17.567520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d39785ac-6c6f-4be3-8ad3-9106a518254a None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:17.568763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d39785ac-6c6f-4be3-8ad3-9106a518254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:17.576241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1152/2328] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 19 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:17.588466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:17.599143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391211bf-5753-4ac5-818b-4ce14a0db6f8 service swift] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:17.604663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:17.605296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:17.605584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:17.605854 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:17.613968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:17.619933 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:17.624552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1177/2329] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:47:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:47:17.852063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:17.852361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:17.852647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:17.876449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:17.876449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:17.883109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1153/2330] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:17.914694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:17.916133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:17.954789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492716c-13e2-4f33-adec-bf3ba93c5e28 service swift] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:17.963044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:17.963971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:17.964424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:17.964801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:17.975716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:17.977512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:17.987577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1178/2331] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:18.361751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:18.363246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:18.375522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2acb7-ac4f-4862-8af2-e16398e18d1b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:18.380108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:18.381518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:18.381798 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:18.382078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] PATH_INFO: `/v3/users/664270256a13431985e4af328e38dcee` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:18.383293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] RBAC: Authorizing `identity:delete_user(user_id=664270256a13431985e4af328e38dcee)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:18.385227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:18.532140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664270256a13431985e4af328e38dcee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:18.539070 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664270256a13431985e4af328e38dcee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:18.588820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664270256a13431985e4af328e38dcee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:18.601036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664270256a13431985e4af328e38dcee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:18.601665 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1475c1a3-b701-42c8-96a9-5567cecc058f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664270256a13431985e4af328e38dcee'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:18.607615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1154/2332] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:47:18 2022] DELETE /identity/v3/users/664270256a13431985e4af328e38dcee => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:47:18.836516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:18.848694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212403-26d5-4288-9cea-51cfe189e7cb service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:18.905598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:18.906509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:18.906798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:18.907115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] PATH_INFO: `/v3/projects/d5a1ee221d7d47209b32ca2b8ec78892` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:18.908554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a1ee221d7d47209b32ca2b8ec78892)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:18.910509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.012130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a1ee221d7d47209b32ca2b8ec78892', 'request_id': 'req-2001036d-b1c2-41df-8f40-c7087eb20516'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:19.017430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a1ee221d7d47209b32ca2b8ec78892', 'request_id': 'req-2001036d-b1c2-41df-8f40-c7087eb20516'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:19.069399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a1ee221d7d47209b32ca2b8ec78892', 'request_id': 'req-2001036d-b1c2-41df-8f40-c7087eb20516'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:19.081717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] The token cache is being invalidate because project d5a1ee221d7d47209b32ca2b8ec78892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:47:19.082229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:19.082949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2001036d-b1c2-41df-8f40-c7087eb20516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:19.084833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1179/2333] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:47:18 2022] DELETE /identity/v3/projects/d5a1ee221d7d47209b32ca2b8ec78892 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:47:19.089869 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b8e3-40cc-4717-a4c4-c100315a29a4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.090180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b8e3-40cc-4717-a4c4-c100315a29a4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.090529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b8e3-40cc-4717-a4c4-c100315a29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.111588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-51d1b8e3-40cc-4717-a4c4-c100315a29a4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:19.116058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-51d1b8e3-40cc-4717-a4c4-c100315a29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:19.165964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:19.178684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1155/2334] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:47:19.186374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c991-3d8d-4465-8896-773e33a44744 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.186742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c991-3d8d-4465-8896-773e33a44744 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.187088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c991-3d8d-4465-8896-773e33a44744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.204706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-89c1c991-3d8d-4465-8896-773e33a44744 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:19.205907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-89c1c991-3d8d-4465-8896-773e33a44744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:19.215084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1180/2335] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:19.228384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b8e3-40cc-4717-a4c4-c100315a29a4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:19.239246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b8e3-40cc-4717-a4c4-c100315a29a4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:19.245821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:19.246633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.247096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.247377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.248118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:47:19.248613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:19.251397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.265302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1156/2336] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:47:19.269309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c991-3d8d-4465-8896-773e33a44744 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:19.279071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c991-3d8d-4465-8896-773e33a44744 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:19.284537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:19.285202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.285515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.285796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.286544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:19.289936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.362782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1181/2337] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:47:19 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:47:19.367330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:19.377471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc761c7-2e7a-41f1-82ad-3f6550a2f8c0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:19.433786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:19.434487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.434778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.435052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.435847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:19.437785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.491972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1157/2338] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:47:19 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:47:19.496229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:19.506649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05f2ea-c70e-489f-9bdf-f31273eccdde admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:19.511313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:19.511965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.512255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.512547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.513267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:19.514977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.517123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:19.525742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1182/2339] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:47:19.529678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:19.541465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfc871-72aa-4931-b776-000fa09ec52c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:19.546184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b35e1-ee1d-4cf4-8561-df721023aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:19.546873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b35e1-ee1d-4cf4-8561-df721023aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.547163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b35e1-ee1d-4cf4-8561-df721023aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.547461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b35e1-ee1d-4cf4-8561-df721023aa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.548197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b35e1-ee1d-4cf4-8561-df721023aa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:19.549791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b35e1-ee1d-4cf4-8561-df721023aa9c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.559826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1158/2340] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:47:19.563859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:19.573694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd022d8-b10b-4d6b-9fee-6e7d8a1d9b47 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:19.579013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:19.579880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.580169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.580452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] PATH_INFO: `/v3/projects/57da249a995e4eb08d45c0daa7caddea/users/1c56ac17fa8d4b20bdcd53769acbd713/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.595511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57da249a995e4eb08d45c0daa7caddea, user_id=1c56ac17fa8d4b20bdcd53769acbd713, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:19.598320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.674556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1183/2341] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:47:19 2022] PUT /identity/v3/projects/57da249a995e4eb08d45c0daa7caddea/users/1c56ac17fa8d4b20bdcd53769acbd713/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:47:19.684608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f66d-6b3e-45b1-a8f0-48bf74795d84 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.685109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f66d-6b3e-45b1-a8f0-48bf74795d84 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.685235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f66d-6b3e-45b1-a8f0-48bf74795d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.711764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9b24f66d-6b3e-45b1-a8f0-48bf74795d84 None None] MFA Rules not processed for user `1c56ac17fa8d4b20bdcd53769acbd713`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:19.712964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9b24f66d-6b3e-45b1-a8f0-48bf74795d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:19.784082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1159/2342] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:19.792181 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:19.793872 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:19.850796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf084c8-c919-4176-8a37-bb28e421b183 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:19.854424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:19.855062 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:19.855347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:19.855624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:19.864107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:19.865571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:19.874417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1184/2343] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:21.354877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:21.355425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:21.355514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:21.374438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:21.375781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:21.424429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:21.440208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1160/2344] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:21.456456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:21.457945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:21.541308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7c0a7-986a-4ac3-a378-cf517d3a08e9 service glance] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:21.547263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adecdd-3c87-4113-a818-d107c6fd7ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:21.547945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adecdd-3c87-4113-a818-d107c6fd7ab3 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:21.548231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adecdd-3c87-4113-a818-d107c6fd7ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:21.548539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adecdd-3c87-4113-a818-d107c6fd7ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:21.557308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adecdd-3c87-4113-a818-d107c6fd7ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:21.559136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adecdd-3c87-4113-a818-d107c6fd7ab3 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:21.570545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1185/2345] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:23.652054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:23.653485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:23.756863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e6ca-ad27-47fb-9475-64f2d822b33c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:23.761887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:23.762563 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:23.762849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:23.763127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:23.764970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:23.778784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:23.780407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:23.791213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1161/2346] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:25.103464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208063-4760-4c6e-bdec-282401bf3198 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:25.103983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208063-4760-4c6e-bdec-282401bf3198 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:25.104364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208063-4760-4c6e-bdec-282401bf3198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:25.126077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ac208063-4760-4c6e-bdec-282401bf3198 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:25.127299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ac208063-4760-4c6e-bdec-282401bf3198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:25.135724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1186/2347] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:25.153619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:25.166674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303753-7415-44e3-a79f-b0aa2f1bd877 service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:25.172435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:25.173073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:25.173363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:25.173659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:25.182043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:25.184101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:25.195976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1162/2348] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:29.388479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cae1b-47ea-4fd1-bfeb-d50ccffeb512 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:29.389067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cae1b-47ea-4fd1-bfeb-d50ccffeb512 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:29.389067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cae1b-47ea-4fd1-bfeb-d50ccffeb512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:29.413820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b43cae1b-47ea-4fd1-bfeb-d50ccffeb512 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:29.415706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b43cae1b-47ea-4fd1-bfeb-d50ccffeb512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:29.423710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1187/2349] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:29.439387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:29.452460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b32c-8240-4b9a-9033-eeb0a2466fb0 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:29.458183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:29.458871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:29.459159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:29.459434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:29.468889 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:29.470492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:29.480650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1163/2350] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:33.601330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3cbec-4d61-4470-a1ed-f6c83f41ce19 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:33.601795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3cbec-4d61-4470-a1ed-f6c83f41ce19 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:33.601906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3cbec-4d61-4470-a1ed-f6c83f41ce19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:33.621251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-93d3cbec-4d61-4470-a1ed-f6c83f41ce19 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:33.622475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-93d3cbec-4d61-4470-a1ed-f6c83f41ce19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:33.630260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1188/2351] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:33.645225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:33.656587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5130e-ef58-4a23-9869-21902d06ec06 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:33.662191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50934fdd-8c38-4556-8d29-6a007c6b56ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:33.662842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934fdd-8c38-4556-8d29-6a007c6b56ac service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:33.663132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934fdd-8c38-4556-8d29-6a007c6b56ac service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:33.663408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934fdd-8c38-4556-8d29-6a007c6b56ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:33.671863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50934fdd-8c38-4556-8d29-6a007c6b56ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:33.673431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50934fdd-8c38-4556-8d29-6a007c6b56ac service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:33.683419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1164/2352] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:43.614949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:43.678470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=64 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:47.431208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3cbec-4d61-4470-a1ed-f6c83f41ce19 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:47.440974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3cbec-4d61-4470-a1ed-f6c83f41ce19 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:47.445803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:47.446782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:47.447076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:47.447354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] PATH_INFO: `/v3/users/1c56ac17fa8d4b20bdcd53769acbd713` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:47.448535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c56ac17fa8d4b20bdcd53769acbd713)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:47.451194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:47.626001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c56ac17fa8d4b20bdcd53769acbd713'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:47.632868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c56ac17fa8d4b20bdcd53769acbd713'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:47.633589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c56ac17fa8d4b20bdcd53769acbd713'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:47.634183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c56ac17fa8d4b20bdcd53769acbd713'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:47.691884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c56ac17fa8d4b20bdcd53769acbd713'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:47.709878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1189/2353] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:47:47 2022] DELETE /identity/v3/users/1c56ac17fa8d4b20bdcd53769acbd713 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:47:47.714434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:47.714923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:47.715019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:47.732957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:47.734155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:47.794361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1165/2354] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:47.803981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:47.805385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:47.865736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c69b6-1b67-45e4-99a8-19ff7b18d01f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:47.869391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d010748-3ce5-4e9b-bff0-a1a488f42b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:47.870042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d010748-3ce5-4e9b-bff0-a1a488f42b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:47.870443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d010748-3ce5-4e9b-bff0-a1a488f42b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:47.870645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d010748-3ce5-4e9b-bff0-a1a488f42b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:47.880334 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d010748-3ce5-4e9b-bff0-a1a488f42b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:47.881780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d010748-3ce5-4e9b-bff0-a1a488f42b37 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:47.892103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1190/2355] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:47:48.306175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:47:48.307641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:48.320022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5076-81f6-4a61-bb64-3b3b4690e798 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:47:48.326038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:47:48.327021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:48.327362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:48.327802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] PATH_INFO: `/v3/projects/57da249a995e4eb08d45c0daa7caddea` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:48.328978 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57da249a995e4eb08d45c0daa7caddea)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:47:48.331098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:47:48.464277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57da249a995e4eb08d45c0daa7caddea', 'request_id': 'req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:48.470352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57da249a995e4eb08d45c0daa7caddea', 'request_id': 'req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:48.571933 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57da249a995e4eb08d45c0daa7caddea', 'request_id': 'req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:48.584044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] The token cache is being invalidate because project 57da249a995e4eb08d45c0daa7caddea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:47:48.584336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:48.584967 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-878ec8a3-c85c-47f4-8625-7a879a5b1f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:47:48.586573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1166/2356] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:47:48 2022] DELETE /identity/v3/projects/57da249a995e4eb08d45c0daa7caddea => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:47:50.592717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08665c0c-2497-4a04-ba38-2408e76cc3fc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:50.593102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08665c0c-2497-4a04-ba38-2408e76cc3fc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:50.593271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08665c0c-2497-4a04-ba38-2408e76cc3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:50.609895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-08665c0c-2497-4a04-ba38-2408e76cc3fc None None] MFA Rules not processed for user `fe070638c83241d0a770a549b4517223`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:50.611262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-08665c0c-2497-4a04-ba38-2408e76cc3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:50.669232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1191/2357] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:47:57.902165 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:47:57.903278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:47:57.903278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:47:57.920636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] MFA Rules not processed for user `bafd0e09a6134be080a352b63d867356`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:47:57.921809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:47:57.975708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1167/2358] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:48:00.661572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:48:07.969679 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:48:10.034080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c639ad-f0f7-407f-9d93-09decbafb6df None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:10.034970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c639ad-f0f7-407f-9d93-09decbafb6df None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:10.035281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c639ad-f0f7-407f-9d93-09decbafb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:10.058086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-11c639ad-f0f7-407f-9d93-09decbafb6df None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:48:10.060130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-11c639ad-f0f7-407f-9d93-09decbafb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:10.130118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1192/2359] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:48:10.144982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:48:10.146498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:10.263100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e3af2-7418-4bf8-9c9c-6923f3f17b7c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:48:10.272331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:48:10.273598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:10.274203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:10.279667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:10.314148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:48:10.314635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:48:10.339445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1168/2360] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:48:13.667218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c074-ee2b-4b36-ab9c-f27be46e6764 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:13.667708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c074-ee2b-4b36-ab9c-f27be46e6764 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:13.667812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c074-ee2b-4b36-ab9c-f27be46e6764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:13.685862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e957c074-ee2b-4b36-ab9c-f27be46e6764 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:48:13.690587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e957c074-ee2b-4b36-ab9c-f27be46e6764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:13.695168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1193/2361] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:48:13.710643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:48:13.722538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2f5a-20b5-46de-bde1-79849bd060c0 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:48:13.728460 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbc7fd-e721-47ef-9eef-fb2d6068e976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:48:13.729106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbc7fd-e721-47ef-9eef-fb2d6068e976 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:13.729394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbc7fd-e721-47ef-9eef-fb2d6068e976 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:13.729675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbc7fd-e721-47ef-9eef-fb2d6068e976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:13.738800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbc7fd-e721-47ef-9eef-fb2d6068e976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:48:13.740647 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbc7fd-e721-47ef-9eef-fb2d6068e976 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:48:13.752112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1169/2362] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:48:14.620557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7ef41-5e16-440e-b9bd-2d6115c11355 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:14.620853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7ef41-5e16-440e-b9bd-2d6115c11355 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:14.621731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7ef41-5e16-440e-b9bd-2d6115c11355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:14.644709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-feb7ef41-5e16-440e-b9bd-2d6115c11355 None None] MFA Rules not processed for user `5205045922ca4dab8d556845be5f574b`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:48:14.646254 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-feb7ef41-5e16-440e-b9bd-2d6115c11355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:14.701303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1194/2363] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:48:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:48:16.517072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0dce-88bb-4483-b2e4-44692d6d9fdd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:16.517509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0dce-88bb-4483-b2e4-44692d6d9fdd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:16.517702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0dce-88bb-4483-b2e4-44692d6d9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:16.536231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dc2c0dce-88bb-4483-b2e4-44692d6d9fdd None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:48:16.537412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dc2c0dce-88bb-4483-b2e4-44692d6d9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:16.545815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1170/2364] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:48:16.561363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7ef41-5e16-440e-b9bd-2d6115c11355 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:48:16.574566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7ef41-5e16-440e-b9bd-2d6115c11355 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:48:16.580615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:48:16.581303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:16.581595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:16.581884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:16.591712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:48:16.593445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:48:16.603503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1195/2365] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:48:19.743250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0af5-59ac-47f1-8619-ef1ad69bd2e9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:19.743749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0af5-59ac-47f1-8619-ef1ad69bd2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:19.743878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0af5-59ac-47f1-8619-ef1ad69bd2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:19.762463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bfeb0af5-59ac-47f1-8619-ef1ad69bd2e9 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:48:19.763654 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bfeb0af5-59ac-47f1-8619-ef1ad69bd2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:19.772490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1171/2366] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:48:19.789577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:48:19.805510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5acf4-1b21-4087-9155-0b27f0163d42 service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:48:19.812174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:48:19.812907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:19.813290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:19.813641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:19.822691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:48:19.824373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:48:19.834242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1196/2367] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:48:22.969146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628f23-2d2d-4dd8-b4d3-506ce9eb84de None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:22.969623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628f23-2d2d-4dd8-b4d3-506ce9eb84de None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:22.969720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628f23-2d2d-4dd8-b4d3-506ce9eb84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:22.988772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ad628f23-2d2d-4dd8-b4d3-506ce9eb84de None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:48:22.989969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ad628f23-2d2d-4dd8-b4d3-506ce9eb84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:22.999587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1172/2368] 10.222.0.97 () {58 vars in 1016 bytes} [Thu May 19 21:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:48:23.018708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:48:23.020233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:23.035915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c10b-9b44-4e47-b449-240593e22165 service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:48:23.041576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:48:23.042232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:23.042654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:23.043632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:23.052678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:48:23.054275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:48:23.064279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1197/2369] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:48:32.982636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=49 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:48:33.059771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=73 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:48:41.260059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee093-004c-4b2d-b326-75acafa19443 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:41.260609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee093-004c-4b2d-b326-75acafa19443 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:41.260899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee093-004c-4b2d-b326-75acafa19443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:41.278604 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f63ee093-004c-4b2d-b326-75acafa19443 None None] MFA Rules not processed for user `102a611e510d4087b09bf7206c2d302a`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:48:41.280319 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f63ee093-004c-4b2d-b326-75acafa19443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:41.338279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1173/2370] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:48:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:48:51.331551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=25 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:48:58.609184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:48:58.613714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:48:58.627947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb8d7-a2ef-4c1d-87e0-32b5bd6ff09b service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:48:58.632843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:48:58.633706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:58.634403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:58.634403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] PATH_INFO: `/v3/users/fe070638c83241d0a770a549b4517223` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:58.635452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe070638c83241d0a770a549b4517223)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:48:58.637557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:48:58.843337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe070638c83241d0a770a549b4517223'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:58.850936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe070638c83241d0a770a549b4517223'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:58.851640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe070638c83241d0a770a549b4517223'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:58.852250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe070638c83241d0a770a549b4517223'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:58.925571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe070638c83241d0a770a549b4517223'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:58.944110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1198/2371] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:48:58 2022] DELETE /identity/v3/users/fe070638c83241d0a770a549b4517223 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:48:59.190935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee093-004c-4b2d-b326-75acafa19443 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:48:59.212131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee093-004c-4b2d-b326-75acafa19443 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:48:59.277758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:48:59.278656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:48:59.278965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:48:59.279233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] PATH_INFO: `/v3/projects/95a4aa19704f4d82beafc721d1027595` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:48:59.280444 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a4aa19704f4d82beafc721d1027595)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:48:59.282911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:48:59.372304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a4aa19704f4d82beafc721d1027595', 'request_id': 'req-636234a3-a632-4785-8130-2320622364d6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:59.378735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a4aa19704f4d82beafc721d1027595', 'request_id': 'req-636234a3-a632-4785-8130-2320622364d6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:59.439653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a4aa19704f4d82beafc721d1027595', 'request_id': 'req-636234a3-a632-4785-8130-2320622364d6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:59.451737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] The token cache is being invalidate because project 95a4aa19704f4d82beafc721d1027595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:48:59.451963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:59.452602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:48:59.454158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1174/2372] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:48:59 2022] DELETE /identity/v3/projects/95a4aa19704f4d82beafc721d1027595 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:07.318440 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:07.319993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:07.334022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e2591-e805-4485-89d8-d65c6e44074b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:07.399825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:07.400707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:07.400992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:07.401271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] PATH_INFO: `/v3/users/bafd0e09a6134be080a352b63d867356` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:07.402471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafd0e09a6134be080a352b63d867356)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:07.404409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:07.573296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafd0e09a6134be080a352b63d867356'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:07.580337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafd0e09a6134be080a352b63d867356'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:07.581041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafd0e09a6134be080a352b63d867356'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:07.581652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafd0e09a6134be080a352b63d867356'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:07.627957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cd943025-eb40-4460-8f8e-393ef1e4306d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafd0e09a6134be080a352b63d867356'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:07.637556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:07.647700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1199/2373] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:49:07 2022] DELETE /identity/v3/users/bafd0e09a6134be080a352b63d867356 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:07.881619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:07.883090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:07.900635 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636234a3-a632-4785-8130-2320622364d6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:07.958535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:07.959384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:07.959663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:07.959936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] PATH_INFO: `/v3/projects/5b42e3ff41384cafaebde677d260ae34` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:07.961107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b42e3ff41384cafaebde677d260ae34)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:07.963047 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:08.051403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:08.063073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b42e3ff41384cafaebde677d260ae34', 'request_id': 'req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:08.068610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b42e3ff41384cafaebde677d260ae34', 'request_id': 'req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:08.119885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b42e3ff41384cafaebde677d260ae34', 'request_id': 'req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:08.131420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] The token cache is being invalidate because project 5b42e3ff41384cafaebde677d260ae34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:49:08.131710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:08.132336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f1a8d05-0c29-4eb9-971d-88135cd5ad06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:08.133879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1175/2374] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:49:07 2022] DELETE /identity/v3/projects/5b42e3ff41384cafaebde677d260ae34 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:08.144852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c0b8b-720b-4118-9a8d-a4fc66c655cb None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.145157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c0b8b-720b-4118-9a8d-a4fc66c655cb None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.145458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c0b8b-720b-4118-9a8d-a4fc66c655cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.165683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-cc4c0b8b-720b-4118-9a8d-a4fc66c655cb None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:08.166824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cc4c0b8b-720b-4118-9a8d-a4fc66c655cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:08.225110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1200/2375] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:08.233333 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195334b-cb4e-46f5-aacb-001aacc53f1c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.233628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195334b-cb4e-46f5-aacb-001aacc53f1c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.233911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195334b-cb4e-46f5-aacb-001aacc53f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.251912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a195334b-cb4e-46f5-aacb-001aacc53f1c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:08.253103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a195334b-cb4e-46f5-aacb-001aacc53f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:08.261021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1176/2376] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:08.265046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c0b8b-720b-4118-9a8d-a4fc66c655cb None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:08.274693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c0b8b-720b-4118-9a8d-a4fc66c655cb None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:08.279931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:08.280587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.280874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.281149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.282129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:49:08.282464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:08.284058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:08.296452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1201/2377] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:49:08.300785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195334b-cb4e-46f5-aacb-001aacc53f1c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:08.310038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195334b-cb4e-46f5-aacb-001aacc53f1c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:08.314725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:08.315409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.315688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.315968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.316675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:08.318623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:08.496806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1177/2378] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:49:08 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:08.497083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:08.501628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4df68-3953-4a0b-b07b-bba168729fe7 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:08.556448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:08.557115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.557404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.557685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.558411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:08.560385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:08.714978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1202/2379] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:49:08 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:08.719296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:08.729526 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f399-58b6-43aa-b24c-b570cd6dc6cf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:08.734353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:08.734999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.735280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.735555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.736322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:08.738079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:08.750871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1178/2380] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:08.754688 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:08.766678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f26f06-a6d9-44a6-954b-eb938d236500 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:08.771839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90152626-8586-4a81-9dd2-93e2ad2936ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:08.772495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152626-8586-4a81-9dd2-93e2ad2936ff admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.772781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152626-8586-4a81-9dd2-93e2ad2936ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.773063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152626-8586-4a81-9dd2-93e2ad2936ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.773780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90152626-8586-4a81-9dd2-93e2ad2936ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:08.775551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90152626-8586-4a81-9dd2-93e2ad2936ff admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:08.785651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1203/2381] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:08.789856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:08.799828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d8af-d463-47aa-a036-1070f807f274 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:08.804381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:08.805245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.805531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.805807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] PATH_INFO: `/v3/projects/5030930a3e664172950df6f8d089785e/users/157cf9345d08457a92653a500a606089/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.820922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5030930a3e664172950df6f8d089785e, user_id=157cf9345d08457a92653a500a606089, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:08.823598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:08.903637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1179/2382] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:08 2022] PUT /identity/v3/projects/5030930a3e664172950df6f8d089785e/users/157cf9345d08457a92653a500a606089/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:49:08.914025 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb2eb-b194-4e30-8f35-b023717f3691 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:08.914347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb2eb-b194-4e30-8f35-b023717f3691 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:08.914629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb2eb-b194-4e30-8f35-b023717f3691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:08.940771 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8fecb2eb-b194-4e30-8f35-b023717f3691 None None] MFA Rules not processed for user `157cf9345d08457a92653a500a606089`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:08.941963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8fecb2eb-b194-4e30-8f35-b023717f3691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:08.985655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:09.007820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1204/2383] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:09.012331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:09.073827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352b950-c18b-4a71-9a17-09124747d650 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:09.079347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:09.079998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.080276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.080549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.081232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:09.083172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:09.172173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1180/2384] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:49:09 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:09.176153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb2eb-b194-4e30-8f35-b023717f3691 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:09.186820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb2eb-b194-4e30-8f35-b023717f3691 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:09.241442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:09.242111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.242432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.242715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.243400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:09.245331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:09.326502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1205/2385] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:49:09 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:09.330674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:09.340926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5f02-bb7f-4db7-a375-c584ddbfabdb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:09.346205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:09.346947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.347246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.347522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.348259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:09.349847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:09.360291 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1181/2386] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:09.364307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:09.374295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e94c-7b8c-4ad4-ad4e-3c85c17c64a0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:09.380184 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:09.381155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.381483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.381756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] PATH_INFO: `/v3/projects/09c6f24d5d17471fbef195cf30a649a0/users/a445e95e55bb4ce59a07820dd8cbf4c3/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.397289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c6f24d5d17471fbef195cf30a649a0, user_id=a445e95e55bb4ce59a07820dd8cbf4c3, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:09.400065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:09.462509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1206/2387] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:09 2022] PUT /identity/v3/projects/09c6f24d5d17471fbef195cf30a649a0/users/a445e95e55bb4ce59a07820dd8cbf4c3/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:49:09.466593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:09.476684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff32f0-90dd-4a77-a154-db8c3111bb53 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:09.505128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:09.533812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1a39-876b-4af9-b104-32c8153426a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:09.534445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1a39-876b-4af9-b104-32c8153426a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.534734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1a39-876b-4af9-b104-32c8153426a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.535015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1a39-876b-4af9-b104-32c8153426a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.535762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1a39-876b-4af9-b104-32c8153426a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:09.537356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1a39-876b-4af9-b104-32c8153426a0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:09.547451 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1182/2388] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:09.551726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:09.563339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129eb48-7e4a-481c-84c7-14a3b7240a20 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:09.567870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:09.568736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.569018 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.569290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] PATH_INFO: `/v3/projects/09c6f24d5d17471fbef195cf30a649a0/users/a445e95e55bb4ce59a07820dd8cbf4c3/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.571260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c6f24d5d17471fbef195cf30a649a0, user_id=a445e95e55bb4ce59a07820dd8cbf4c3, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:09.573865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:09.584368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1207/2389] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:09 2022] PUT /identity/v3/projects/09c6f24d5d17471fbef195cf30a649a0/users/a445e95e55bb4ce59a07820dd8cbf4c3/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:09.595297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1f2b-9021-4cb2-bca5-4dcd18f717f1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.595594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1f2b-9021-4cb2-bca5-4dcd18f717f1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.595876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1f2b-9021-4cb2-bca5-4dcd18f717f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.621565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-498f1f2b-9021-4cb2-bca5-4dcd18f717f1 None None] MFA Rules not processed for user `a445e95e55bb4ce59a07820dd8cbf4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:09.623464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-498f1f2b-9021-4cb2-bca5-4dcd18f717f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:09.690137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1183/2390] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:09.701967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:09.703650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:09.780145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58b86c-579f-4d05-bcde-0044eb5ad288 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:09.784116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:09.784694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:09.784978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:09.785256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:09.794955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:09.796416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:09.806296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1208/2391] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:10.037389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f1f2b-9021-4cb2-bca5-4dcd18f717f1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:10.045658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f1f2b-9021-4cb2-bca5-4dcd18f717f1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:10.049272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:10.049926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:10.050223 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:10.050548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:10.106747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:10.108783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:10.125885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1184/2392] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:19.801923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:20.115434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=77 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:23.829874 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:23.831394 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:23.886734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafffbf-2e02-4c90-b696-f6d3d822e99f service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:23.890343 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d35e26-0636-4094-a3e5-dfbc80b2f227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:23.891578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35e26-0636-4094-a3e5-dfbc80b2f227 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:23.891864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35e26-0636-4094-a3e5-dfbc80b2f227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:23.892143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35e26-0636-4094-a3e5-dfbc80b2f227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:23.893938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-76d35e26-0636-4094-a3e5-dfbc80b2f227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:23.968639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d35e26-0636-4094-a3e5-dfbc80b2f227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:23.970077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d35e26-0636-4094-a3e5-dfbc80b2f227 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:23.981073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1209/2393] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:25.156005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:25.157692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:25.169209 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f73a-a760-4617-8c80-1fee733c775b service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:25.172711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:25.173336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:25.173616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:25.173888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:25.175622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:25.189126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:25.190569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:25.201278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1185/2394] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:33.976084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=54 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:35.183117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:35.183687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:35.186135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:35.196435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:35.201654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:35.202951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:35.259457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1210/2395] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:49:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:35.495309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:35.496709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:35.575906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bc464-b51a-4661-86ba-b36d5a632bfe service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:35.581486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:35.582149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:35.583298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:35.583298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:35.592016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:35.594294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:35.602529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1186/2396] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:49:35.724494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:35.726515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:35.744861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5012ae-cd14-411d-8922-33eaf02f371f None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:35.751311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:35.751958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:35.752240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:35.752523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:35.754473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:35.836395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:35.838186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:35.850810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1211/2397] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:36.505125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:36.516387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f84aa-c4dc-4f4e-9cc6-8720f001201e service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:36.521002 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:36.521982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:36.522573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:36.523084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:36.525207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:36.602882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:36.604496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:36.621892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1187/2398] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:45.845665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=53 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:46.609965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=65 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:46.882177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:46.951695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744d1b6-8402-4ca5-8ea6-0c7a3cbc619e service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:46.956775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:46.957638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:46.957919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:46.958191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] PATH_INFO: `/v3/users/157cf9345d08457a92653a500a606089` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:46.959384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157cf9345d08457a92653a500a606089)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:46.961280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:47.093111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:47.102723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268bd0-a4c5-41da-9d74-cfc2f5041366 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:47.104887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157cf9345d08457a92653a500a606089'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:47.106595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b6c67-ce8f-465d-8113-cc1c903ecc47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:47.107243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6c67-ce8f-465d-8113-cc1c903ecc47 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:47.107523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6c67-ce8f-465d-8113-cc1c903ecc47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:47.107800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b6c67-ce8f-465d-8113-cc1c903ecc47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:47.109597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d55b6c67-ce8f-465d-8113-cc1c903ecc47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:47.112148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157cf9345d08457a92653a500a606089'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:47.112737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157cf9345d08457a92653a500a606089'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:47.113302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157cf9345d08457a92653a500a606089'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:47.119975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b6c67-ce8f-465d-8113-cc1c903ecc47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:47.124672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b6c67-ce8f-465d-8113-cc1c903ecc47 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:47.130353 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1188/2399] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:49:47.182149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157cf9345d08457a92653a500a606089'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:47.200754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1212/2400] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:49:46 2022] DELETE /identity/v3/users/157cf9345d08457a92653a500a606089 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:47.205966 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:47.206334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:47.206622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:47.223462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:47.224648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:47.292849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1189/2401] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:47.302567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:47.303995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:47.365867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ae7ff-a59f-408e-9320-633f1d4b3229 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:47.372037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:47.373340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:47.373632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:47.373910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:47.384746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:47.386186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:47.396995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1213/2402] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:47.836498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:47.839218 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:47.851074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f0cf7-3792-4f10-a9cc-d780c2366323 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:47.857512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:47.858890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:47.859437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:47.859874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] PATH_INFO: `/v3/projects/5030930a3e664172950df6f8d089785e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:47.861416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5030930a3e664172950df6f8d089785e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:47.864326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:47.982924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5030930a3e664172950df6f8d089785e', 'request_id': 'req-9328aefd-37b1-4139-9bab-0cf8513a28e4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:47.989025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5030930a3e664172950df6f8d089785e', 'request_id': 'req-9328aefd-37b1-4139-9bab-0cf8513a28e4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.062861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5030930a3e664172950df6f8d089785e', 'request_id': 'req-9328aefd-37b1-4139-9bab-0cf8513a28e4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.074631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] The token cache is being invalidate because project 5030930a3e664172950df6f8d089785e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:49:48.074924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.075571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.077125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1190/2403] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:49:47 2022] DELETE /identity/v3/projects/5030930a3e664172950df6f8d089785e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:48.081063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:48.091233 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb029f-3060-4bcc-88c0-1eb62307e306 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:48.122339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:48.160845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:48.161724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:48.162005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:48.162314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] PATH_INFO: `/v3/users/a445e95e55bb4ce59a07820dd8cbf4c3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:48.163477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a445e95e55bb4ce59a07820dd8cbf4c3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:48.165385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:48.344389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a445e95e55bb4ce59a07820dd8cbf4c3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.351213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a445e95e55bb4ce59a07820dd8cbf4c3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.351865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a445e95e55bb4ce59a07820dd8cbf4c3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.352460 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a445e95e55bb4ce59a07820dd8cbf4c3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.433484 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-68a01e2e-8b4a-4c4e-8083-e58eefa386e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a445e95e55bb4ce59a07820dd8cbf4c3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:48.451937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1214/2404] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:49:48 2022] DELETE /identity/v3/users/a445e95e55bb4ce59a07820dd8cbf4c3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:48.869123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:48.870676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:48.884546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328aefd-37b1-4139-9bab-0cf8513a28e4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:48.943552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:48.944477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:48.944759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:48.945064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] PATH_INFO: `/v3/projects/09c6f24d5d17471fbef195cf30a649a0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:48.946304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c6f24d5d17471fbef195cf30a649a0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:48.948240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:48.960871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:49.063242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c6f24d5d17471fbef195cf30a649a0', 'request_id': 'req-c014bb90-9735-4718-87a3-43728000add5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:49.068505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c6f24d5d17471fbef195cf30a649a0', 'request_id': 'req-c014bb90-9735-4718-87a3-43728000add5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:49.154381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c6f24d5d17471fbef195cf30a649a0', 'request_id': 'req-c014bb90-9735-4718-87a3-43728000add5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:49.177243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] The token cache is being invalidate because project 09c6f24d5d17471fbef195cf30a649a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:49:49.177688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:49.178516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c014bb90-9735-4718-87a3-43728000add5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:49.180731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1191/2405] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:49:48 2022] DELETE /identity/v3/projects/09c6f24d5d17471fbef195cf30a649a0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:49.185793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623088-94f2-4493-8073-76695e3042ab None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.186348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623088-94f2-4493-8073-76695e3042ab None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.186514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623088-94f2-4493-8073-76695e3042ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.205305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c2623088-94f2-4493-8073-76695e3042ab None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:49.206673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c2623088-94f2-4493-8073-76695e3042ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:49.269061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1215/2406] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:49.276873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3f4c-d6c1-41e6-b6db-a7a98d4034f6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.277295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3f4c-d6c1-41e6-b6db-a7a98d4034f6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.277682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3f4c-d6c1-41e6-b6db-a7a98d4034f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.300276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dcbe3f4c-d6c1-41e6-b6db-a7a98d4034f6 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:49.301806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dcbe3f4c-d6c1-41e6-b6db-a7a98d4034f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:49.309413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1192/2407] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:49.313583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623088-94f2-4493-8073-76695e3042ab None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:49.324118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623088-94f2-4493-8073-76695e3042ab None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:49.328848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:49.329536 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.329823 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.330101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.330867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:49:49.331182 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:49.332794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:49.345860 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1216/2408] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:49:49.349823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe3f4c-d6c1-41e6-b6db-a7a98d4034f6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:49.360138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe3f4c-d6c1-41e6-b6db-a7a98d4034f6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:49.364393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:49.365041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.365324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.365593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.366339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:49.368244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:49.435135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1193/2409] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:49:49 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:49.439355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:49.449350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fee24-b36d-4426-8edc-a1a7740f4a9b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:49.476353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:49.506094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:49.506796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.507081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.507359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.508056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:49.510065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:49.605251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1217/2410] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:49:49 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:49.609366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:49.620366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412484d-26be-494c-a76e-3b54c3406416 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:49.625803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:49.626511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.626834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.627100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.627834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:49.629477 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:49.641591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1194/2411] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:49.645776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:49.657141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91470d-05b8-4513-8fbd-68deae67737c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:49.662123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ec0ff-a078-4876-9aa8-7d46e8f304b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:49.665740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec0ff-a078-4876-9aa8-7d46e8f304b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.665740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec0ff-a078-4876-9aa8-7d46e8f304b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.665740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec0ff-a078-4876-9aa8-7d46e8f304b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.665740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ec0ff-a078-4876-9aa8-7d46e8f304b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:49.665740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ec0ff-a078-4876-9aa8-7d46e8f304b5 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:49.676004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1218/2412] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:49.680246 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:49.690121 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3733d-5ac0-4ca1-9470-c2db8cc2d363 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:49.694680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:49.695542 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.695822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.696104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] PATH_INFO: `/v3/projects/a258d1ba1f1142b19cc4e9765a3a154b/users/3f826a8a53a14ec994c17cd99b49962a/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.711277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a258d1ba1f1142b19cc4e9765a3a154b, user_id=3f826a8a53a14ec994c17cd99b49962a, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:49.713907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:49.795605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1195/2413] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:49 2022] PUT /identity/v3/projects/a258d1ba1f1142b19cc4e9765a3a154b/users/3f826a8a53a14ec994c17cd99b49962a/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:49.810595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbcd65-dd9e-4f26-b0a7-04f89b97bed2 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.810992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbcd65-dd9e-4f26-b0a7-04f89b97bed2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.811489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbcd65-dd9e-4f26-b0a7-04f89b97bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.839415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-d6cbcd65-dd9e-4f26-b0a7-04f89b97bed2 None None] MFA Rules not processed for user `3f826a8a53a14ec994c17cd99b49962a`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:49.840606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d6cbcd65-dd9e-4f26-b0a7-04f89b97bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:49.903556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1219/2414] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:49:49.908885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:49.973522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1b00b-b0f6-4e71-ac5f-7f5f2dbba548 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:49.978741 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:49.979409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:49.979695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:49.979974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:49.980685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:49.982758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:50.121797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1196/2415] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:49:49 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:50.126762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbcd65-dd9e-4f26-b0a7-04f89b97bed2 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:50.138748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbcd65-dd9e-4f26-b0a7-04f89b97bed2 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:50.206514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:50.208056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:50.208606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:50.210283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:50.211271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:50.213493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:50.408091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1220/2416] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:49:50 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:49:50.412089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:50.424269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20451-e67e-4abe-9bfe-35251a39a6fb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:50.452773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:50.453644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:50.454036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:50.454442 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:50.455366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:50.457518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:50.473794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1197/2417] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:49:50.479323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:50.491362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555ed27-2950-48dc-9169-984d17694696 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:50.497051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:50.498170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:50.498550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:50.498890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] PATH_INFO: `/v3/projects/67e5795e6d2e40bd8ca5ee66675a95a8/users/39f6dd066ab5424c84fb8f02c6e65cb3/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:50.515765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e5795e6d2e40bd8ca5ee66675a95a8, user_id=39f6dd066ab5424c84fb8f02c6e65cb3, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:50.518508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:50.617419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1221/2418] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:50 2022] PUT /identity/v3/projects/67e5795e6d2e40bd8ca5ee66675a95a8/users/39f6dd066ab5424c84fb8f02c6e65cb3/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:49:50.621367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:50.631465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcda229-b8b3-4eb0-8c4d-9e6bf340daef admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:50.639248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:50.686820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f44136-3e32-4ebe-92c4-e7e23cdcfe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:50.687488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44136-3e32-4ebe-92c4-e7e23cdcfe88 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:50.687800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44136-3e32-4ebe-92c4-e7e23cdcfe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:50.688086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44136-3e32-4ebe-92c4-e7e23cdcfe88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:50.688807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f44136-3e32-4ebe-92c4-e7e23cdcfe88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:50.690506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f44136-3e32-4ebe-92c4-e7e23cdcfe88 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:50.701153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1198/2419] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:50.705396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:50.711098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:50.722342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d16ad9-1d4f-42ae-b73e-a41ac44af87d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:50.723965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:50.724991 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:50.725346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:50.725734 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] PATH_INFO: `/v3/projects/67e5795e6d2e40bd8ca5ee66675a95a8/users/39f6dd066ab5424c84fb8f02c6e65cb3/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:50.727975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e5795e6d2e40bd8ca5ee66675a95a8, user_id=39f6dd066ab5424c84fb8f02c6e65cb3, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:50.730725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:50.743305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1222/2420] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:50 2022] PUT /identity/v3/projects/67e5795e6d2e40bd8ca5ee66675a95a8/users/39f6dd066ab5424c84fb8f02c6e65cb3/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:49:50.758952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab973f-5cda-462c-9539-4e5e2bb6aca9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:50.759271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab973f-5cda-462c-9539-4e5e2bb6aca9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:50.759557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab973f-5cda-462c-9539-4e5e2bb6aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:50.788672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b2ab973f-5cda-462c-9539-4e5e2bb6aca9 None None] MFA Rules not processed for user `39f6dd066ab5424c84fb8f02c6e65cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:50.790059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b2ab973f-5cda-462c-9539-4e5e2bb6aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:50.872404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1199/2421] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:50.884026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:50.885697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:50.945983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ad478-78a6-47ea-baaa-eb8d4e1f8a0a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:50.949648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1d20-5422-49fb-92d3-20e2211de25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:50.950326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1d20-5422-49fb-92d3-20e2211de25b service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:50.950611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1d20-5422-49fb-92d3-20e2211de25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:50.950885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1d20-5422-49fb-92d3-20e2211de25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:50.960348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1d20-5422-49fb-92d3-20e2211de25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:50.961783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1d20-5422-49fb-92d3-20e2211de25b service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:50.971789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1223/2422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:51.995272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab973f-5cda-462c-9539-4e5e2bb6aca9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:52.067898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab973f-5cda-462c-9539-4e5e2bb6aca9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:52.075203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:52.075998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:52.076240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:52.076519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] PATH_INFO: `/v3/users/3f826a8a53a14ec994c17cd99b49962a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:52.077870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f826a8a53a14ec994c17cd99b49962a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:52.079948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:52.319779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:52.328850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f826a8a53a14ec994c17cd99b49962a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:52.336118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f826a8a53a14ec994c17cd99b49962a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:52.428365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f826a8a53a14ec994c17cd99b49962a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:52.443230 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f826a8a53a14ec994c17cd99b49962a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:52.443952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f826a8a53a14ec994c17cd99b49962a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:52.454114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1200/2423] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:49:51 2022] DELETE /identity/v3/users/3f826a8a53a14ec994c17cd99b49962a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:52.456402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:52.456916 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:52.457044 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:52.478149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:52.480221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:52.560663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1224/2424] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:49:52.567944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:52.569421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:52.584413 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:52.591986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:52.651983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bcf33-db63-42fb-9c2b-43f67fc72c95 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:52.652204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ddbec-3b3d-4bf5-afaa-b824fd902804 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:52.656078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:52.656493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:52.657129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:52.657777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:52.658069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:52.658188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:52.658561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:52.658695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:52.660591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:52.668939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:52.670599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:52.670725 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:52.672250 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:52.681063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1225/2425] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:52.681671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1201/2426] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:53.145321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:53.146911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:53.161527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0750e0-56b5-43e5-bd8d-ff6a496304db service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:53.172005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:53.172005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:53.172005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:53.172005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] PATH_INFO: `/v3/projects/a258d1ba1f1142b19cc4e9765a3a154b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:53.172820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a258d1ba1f1142b19cc4e9765a3a154b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:53.172820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:53.298470 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a258d1ba1f1142b19cc4e9765a3a154b', 'request_id': 'req-cafbdc29-83e2-4883-aef0-f1255c11a0ab'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.304277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a258d1ba1f1142b19cc4e9765a3a154b', 'request_id': 'req-cafbdc29-83e2-4883-aef0-f1255c11a0ab'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.370730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a258d1ba1f1142b19cc4e9765a3a154b', 'request_id': 'req-cafbdc29-83e2-4883-aef0-f1255c11a0ab'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.383390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] The token cache is being invalidate because project a258d1ba1f1142b19cc4e9765a3a154b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:49:53.383682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.384334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.385884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1202/2427] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:49:53 2022] DELETE /identity/v3/projects/a258d1ba1f1142b19cc4e9765a3a154b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:53.389903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:53.403744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94776aa5-e7be-4e2d-b532-3985ba57213b service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:53.406493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:53.407897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:53.437931 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:53.451491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:53.462553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:53.463430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:53.463749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:53.464016 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] PATH_INFO: `/v3/users/39f6dd066ab5424c84fb8f02c6e65cb3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:53.465180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f6dd066ab5424c84fb8f02c6e65cb3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:53.467208 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:53.478639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbdc29-83e2-4883-aef0-f1255c11a0ab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:53.483782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:53.484488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:53.489835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:53.489835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:53.489835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:53.498937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:53.500592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:53.511351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1203/2428] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:49:53.647492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f6dd066ab5424c84fb8f02c6e65cb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.654692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f6dd066ab5424c84fb8f02c6e65cb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.655359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f6dd066ab5424c84fb8f02c6e65cb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.656012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f6dd066ab5424c84fb8f02c6e65cb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.747575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e54c5b3e-8a2e-4c7b-af81-7fb35e6b95c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f6dd066ab5424c84fb8f02c6e65cb3'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:53.768239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1226/2429] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:49:53 2022] DELETE /identity/v3/users/39f6dd066ab5424c84fb8f02c6e65cb3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:54.253589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:54.258455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:54.284871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4df79-eed6-4c2f-9380-7af777870362 service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:54.354729 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:54.356037 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:54.356425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:54.356810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] PATH_INFO: `/v3/projects/67e5795e6d2e40bd8ca5ee66675a95a8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:54.358119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e5795e6d2e40bd8ca5ee66675a95a8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:54.360803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:54.467107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e5795e6d2e40bd8ca5ee66675a95a8', 'request_id': 'req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:54.474540 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e5795e6d2e40bd8ca5ee66675a95a8', 'request_id': 'req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:54.542878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e5795e6d2e40bd8ca5ee66675a95a8', 'request_id': 'req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:54.555446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] The token cache is being invalidate because project 67e5795e6d2e40bd8ca5ee66675a95a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:49:54.555898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:54.556662 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fe34231e-eb3f-4fd9-aa5a-21faa43b869d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:49:54.560188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1204/2430] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:49:54 2022] DELETE /identity/v3/projects/67e5795e6d2e40bd8ca5ee66675a95a8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:54.563337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319e31-6545-4a5c-a57a-dd826e03c923 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:54.563833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319e31-6545-4a5c-a57a-dd826e03c923 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:54.564026 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319e31-6545-4a5c-a57a-dd826e03c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:54.581930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-ff319e31-6545-4a5c-a57a-dd826e03c923 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:54.583195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ff319e31-6545-4a5c-a57a-dd826e03c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:54.648702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1227/2431] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:49:54.657740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34318b-af9a-453a-8a6f-c0596809c60b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:54.658284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34318b-af9a-453a-8a6f-c0596809c60b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:54.658629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34318b-af9a-453a-8a6f-c0596809c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:54.678447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7f34318b-af9a-453a-8a6f-c0596809c60b None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:54.679804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7f34318b-af9a-453a-8a6f-c0596809c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:54.687857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1205/2432] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:54.692146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319e31-6545-4a5c-a57a-dd826e03c923 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:54.701963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319e31-6545-4a5c-a57a-dd826e03c923 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:54.707700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:54.708457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:54.708843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:54.709520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:54.710502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:49:54.710816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:54.712644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:54.725396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1228/2433] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:49:54.729831 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34318b-af9a-453a-8a6f-c0596809c60b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:54.739753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34318b-af9a-453a-8a6f-c0596809c60b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:54.744550 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:54.745207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:54.745497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:54.745777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:54.746657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:54.748586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:54.836821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1206/2434] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:49:54 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:54.840878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:54.853966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05534ca8-6d1c-4e34-aec3-db0ff4404d43 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:54.904749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:54.923427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:54.924116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:54.924400 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:54.924686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:54.925390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:54.927355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.054853 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1229/2435] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:49:54 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:49:55.056430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.067262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fbda8-1c09-46b9-a9a6-828fc6fef917 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.071985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.072718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.073024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.073313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.074042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.075716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.087722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1207/2436] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:55.092097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.102421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f103f-bd86-49e3-aeb8-321870b43e08 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.107251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b452-1f5c-4916-93b9-83c4612d30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.108019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b452-1f5c-4916-93b9-83c4612d30c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.108381 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b452-1f5c-4916-93b9-83c4612d30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.108737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b452-1f5c-4916-93b9-83c4612d30c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.109535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b452-1f5c-4916-93b9-83c4612d30c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.111267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b452-1f5c-4916-93b9-83c4612d30c1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.122805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1230/2437] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:55.127710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.137567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08843382-0058-4f47-b0ad-b70e1699159e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.144116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.145005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.145294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.145573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] PATH_INFO: `/v3/projects/861bca590d10424885853525b6688eae/users/ccec7d9da0c04f46a25a9f5d3a68f6f6/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.162250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861bca590d10424885853525b6688eae, user_id=ccec7d9da0c04f46a25a9f5d3a68f6f6, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.164895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.167110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:55.274520 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1208/2438] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:55 2022] PUT /identity/v3/projects/861bca590d10424885853525b6688eae/users/ccec7d9da0c04f46a25a9f5d3a68f6f6/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:55.291101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33d537-f16d-405e-9d4d-9eade8fd4f63 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.291405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33d537-f16d-405e-9d4d-9eade8fd4f63 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.291696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33d537-f16d-405e-9d4d-9eade8fd4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.322346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fc33d537-f16d-405e-9d4d-9eade8fd4f63 None None] MFA Rules not processed for user `ccec7d9da0c04f46a25a9f5d3a68f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:55.323593 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fc33d537-f16d-405e-9d4d-9eade8fd4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:55.395167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1231/2439] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:55.399987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.467005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20ff60-2a28-45db-bfc0-c473fa97c685 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.472041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.472803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.473156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.473506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.474312 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.476360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.585805 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1209/2440] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:49:55 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:55.590524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33d537-f16d-405e-9d4d-9eade8fd4f63 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.608132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33d537-f16d-405e-9d4d-9eade8fd4f63 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.693021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.693755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.694389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.694639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.695229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.697404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.811443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1232/2441] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:49:55 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:55.816057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.826914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ac78f-1b33-4e21-abac-b4fa8f1da990 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.832064 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.833343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.833632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.833908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.834693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.836724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.847338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1210/2442] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:55.852049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.862936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0599-c627-47f3-be78-428288b94b86 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.867553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376526ab-e027-442d-8f55-781a42074bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.868215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376526ab-e027-442d-8f55-781a42074bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.868512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376526ab-e027-442d-8f55-781a42074bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.868787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376526ab-e027-442d-8f55-781a42074bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.869503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376526ab-e027-442d-8f55-781a42074bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.871135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376526ab-e027-442d-8f55-781a42074bc8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:55.882943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1233/2443] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:55.886949 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:55.898081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc088614-3144-4610-a563-31173d1f0968 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:55.906595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:55.906595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:55.906595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:55.906595 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] PATH_INFO: `/v3/projects/606462ba05a7499e9561b849a98142f6/users/0c753ed12b3043d09a2c26d191494b7d/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:55.920202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=606462ba05a7499e9561b849a98142f6, user_id=0c753ed12b3043d09a2c26d191494b7d, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:55.922908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:56.073893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1211/2444] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:55 2022] PUT /identity/v3/projects/606462ba05a7499e9561b849a98142f6/users/0c753ed12b3043d09a2c26d191494b7d/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:56.074751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d984af-d781-4f47-96b5-16f34f4d562b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.075187 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d984af-d781-4f47-96b5-16f34f4d562b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.075531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d984af-d781-4f47-96b5-16f34f4d562b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.105581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:56.107777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:56.141207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-09d984af-d781-4f47-96b5-16f34f4d562b None None] MFA Rules not processed for user `0c753ed12b3043d09a2c26d191494b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:56.144322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-09d984af-d781-4f47-96b5-16f34f4d562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:56.162650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:56.233956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdfa1b-4474-4191-88af-b93419494e8a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:56.242132 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1234/2445] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:56.247328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaf3b9-0cbd-4c59-ac17-127b33774129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:56.247984 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf3b9-0cbd-4c59-ac17-127b33774129 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.248272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf3b9-0cbd-4c59-ac17-127b33774129 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.250310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf3b9-0cbd-4c59-ac17-127b33774129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.250575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-54aaf3b9-0cbd-4c59-ac17-127b33774129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:56.253113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d984af-d781-4f47-96b5-16f34f4d562b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:56.263503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaf3b9-0cbd-4c59-ac17-127b33774129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:56.265268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaf3b9-0cbd-4c59-ac17-127b33774129 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:56.294673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1212/2446] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:56.359601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d984af-d781-4f47-96b5-16f34f4d562b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:56.365136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:56.365815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.366324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.366504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.367225 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:56.369206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:56.405338 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.408907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.408907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.426908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:56.428237 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:56.462039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:56.467301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1235/2447] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:49:56 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:49:56.475412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:56.499488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1213/2448] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:49:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:49:56.512284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:56.513836 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:56.568380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81956aed-77a2-4554-8da7-394ed8abd293 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:56.573545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:56.574391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.574777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.575141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.576035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:56.577978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:56.628938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617963f1-57dc-48c0-b943-2f1e8974e6de None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:56.687418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1236/2449] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:49:56 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:49:56.698633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:56.712137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b24ff4-f373-4c13-bd1a-ac57311e1e47 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:56.713144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:56.714766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.715043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.715323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.718512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:56.719466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.720081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.720474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.721772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:56.723809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:56.738243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1237/2450] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:56.744007 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:56.773738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b7aaf-cc71-45ef-974c-1548cca551a4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:56.789898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:56.790832 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:56.791129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:56.791404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] PATH_INFO: `/v3/projects/fadcbdd1042e4040851fdc3585959eed/users/72c6a25082e046778c7c9637abead369/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:56.805199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:56.807222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:56.810929 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadcbdd1042e4040851fdc3585959eed, user_id=72c6a25082e046778c7c9637abead369, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:56.814363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:56.818464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1214/2451] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 21:49:56.898905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:56.914121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1238/2452] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:56 2022] PUT /identity/v3/projects/fadcbdd1042e4040851fdc3585959eed/users/72c6a25082e046778c7c9637abead369/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:49:56.916626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:56.928181 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3284a5-6000-4ebc-9f58-8ca98b14d098 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:56.942408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:57.048689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016928c-6628-4537-8923-281872cba2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:57.049605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016928c-6628-4537-8923-281872cba2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:57.049748 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016928c-6628-4537-8923-281872cba2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:57.050085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016928c-6628-4537-8923-281872cba2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:57.050857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016928c-6628-4537-8923-281872cba2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:57.052772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016928c-6628-4537-8923-281872cba2c2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:57.081907 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1215/2453] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:49:57.082992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:57.098004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e18f4c-1aa0-4f7f-a16a-fb12f8c2214f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:57.112031 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:57.120488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:57.120488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:57.120488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] PATH_INFO: `/v3/projects/fadcbdd1042e4040851fdc3585959eed/users/72c6a25082e046778c7c9637abead369/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:57.120488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadcbdd1042e4040851fdc3585959eed, user_id=72c6a25082e046778c7c9637abead369, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:57.120488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:57.141993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1239/2454] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:49:57 2022] PUT /identity/v3/projects/fadcbdd1042e4040851fdc3585959eed/users/72c6a25082e046778c7c9637abead369/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:49:57.152264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:57.152649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:57.153008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:57.213368 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] MFA Rules not processed for user `72c6a25082e046778c7c9637abead369`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:49:57.215172 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:57.324305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1216/2455] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:49:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:49:57.339444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:57.341847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:57.432256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d466e5-6906-426b-bd89-77410173fdf7 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:57.437009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:57.437650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:57.438819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:57.439452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:57.451554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:57.454815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:57.476540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1240/2456] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:49:57.579409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:49:57.579409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:49:57.599648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918cc0d-fb68-4dcd-8e0c-bffbfc113a96 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:49:57.603797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe09330-2998-4529-9571-f73595f8f7e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:49:57.604682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe09330-2998-4529-9571-f73595f8f7e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:49:57.604934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe09330-2998-4529-9571-f73595f8f7e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:49:57.605276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe09330-2998-4529-9571-f73595f8f7e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:49:57.690820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe09330-2998-4529-9571-f73595f8f7e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:49:57.692416 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe09330-2998-4529-9571-f73595f8f7e6 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:49:57.705885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1217/2457] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:49:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:02.002148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:02.071905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978e07-780b-42d4-a322-a59d079e0b95 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:02.076687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:02.077561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:02.077980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:02.078292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] PATH_INFO: `/v3/users/ccec7d9da0c04f46a25a9f5d3a68f6f6` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:02.080361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccec7d9da0c04f46a25a9f5d3a68f6f6)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:02.082326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:02.309924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccec7d9da0c04f46a25a9f5d3a68f6f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:02.323257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccec7d9da0c04f46a25a9f5d3a68f6f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:02.324162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccec7d9da0c04f46a25a9f5d3a68f6f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:02.324947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccec7d9da0c04f46a25a9f5d3a68f6f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:02.422595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccec7d9da0c04f46a25a9f5d3a68f6f6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:02.456630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1241/2458] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:02 2022] DELETE /identity/v3/users/ccec7d9da0c04f46a25a9f5d3a68f6f6 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:02.461466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:02.462002 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:02.462103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:02.493839 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:02.496130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:02.561947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:02.600614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1218/2459] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:02.610305 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:02.612950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:02.642968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:02.646652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:02.659136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:02.704978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012752-6518-4310-8f12-3c9425c5d17d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:02.709280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:02.710149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:02.710615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:02.711066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:02.722906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:02.724844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:02.737270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1242/2460] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:02.756090 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43746d-6c32-46b4-a3ec-b6fafec0ed48 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:02.777060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:02.778084 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:02.778493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:02.778913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:02.782357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:02.812535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:02.816999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:02.836947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1219/2461] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:50:03.414889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:03.417069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:03.442566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8c791-41ec-4351-b6d2-f6fb9559184c service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:03.449388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:03.450621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:03.451008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:03.451380 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] PATH_INFO: `/v3/projects/861bca590d10424885853525b6688eae` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:03.452706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861bca590d10424885853525b6688eae)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:03.456118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:03.599873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861bca590d10424885853525b6688eae', 'request_id': 'req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:03.606173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861bca590d10424885853525b6688eae', 'request_id': 'req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:03.685076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861bca590d10424885853525b6688eae', 'request_id': 'req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:03.699962 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] The token cache is being invalidate because project 861bca590d10424885853525b6688eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:03.700238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:03.701166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:03.703272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1243/2462] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:03 2022] DELETE /identity/v3/projects/861bca590d10424885853525b6688eae => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:03.707152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:03.717085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17720130-b546-4876-abed-e9cbfccd1d47 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:03.805954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:03.806954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:03.807245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:03.807536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] PATH_INFO: `/v3/users/0c753ed12b3043d09a2c26d191494b7d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:03.812102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c753ed12b3043d09a2c26d191494b7d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:03.814686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:05.311667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c753ed12b3043d09a2c26d191494b7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:05.331036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c753ed12b3043d09a2c26d191494b7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:05.439796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c753ed12b3043d09a2c26d191494b7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:05.460129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c753ed12b3043d09a2c26d191494b7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:05.460935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c753ed12b3043d09a2c26d191494b7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:05.463714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:05.472973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1220/2463] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:03 2022] DELETE /identity/v3/users/0c753ed12b3043d09a2c26d191494b7d => generated 0 bytes in 1766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:06.146805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:06.148334 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:06.172186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a6a1-40d5-455e-a473-a8d5aa8f3d69 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:06.240693 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:06.241570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:06.241849 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:06.242131 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] PATH_INFO: `/v3/projects/606462ba05a7499e9561b849a98142f6` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:06.243342 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=606462ba05a7499e9561b849a98142f6)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:06.245242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:06.343119 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:06.364174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606462ba05a7499e9561b849a98142f6', 'request_id': 'req-9f805c68-56db-4146-9cdd-95d3dd999aa7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.369710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606462ba05a7499e9561b849a98142f6', 'request_id': 'req-9f805c68-56db-4146-9cdd-95d3dd999aa7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.467890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606462ba05a7499e9561b849a98142f6', 'request_id': 'req-9f805c68-56db-4146-9cdd-95d3dd999aa7'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.481692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] The token cache is being invalidate because project 606462ba05a7499e9561b849a98142f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:06.481692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.482276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.484583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1244/2464] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:06 2022] DELETE /identity/v3/projects/606462ba05a7499e9561b849a98142f6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:06.488837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:06.490567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:06.510961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3029-d757-4d0f-842c-3f39d64a4a41 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:06.572863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:06.573738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:06.574024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:06.574340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] PATH_INFO: `/v3/users/72c6a25082e046778c7c9637abead369` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:06.575633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c6a25082e046778c7c9637abead369)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:06.577666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:06.764349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c6a25082e046778c7c9637abead369'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.804445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c6a25082e046778c7c9637abead369'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.863939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c6a25082e046778c7c9637abead369'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.884001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c6a25082e046778c7c9637abead369'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.885023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c6a25082e046778c7c9637abead369'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:06.914897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1221/2465] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:06 2022] DELETE /identity/v3/users/72c6a25082e046778c7c9637abead369 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:07.368491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:07.370029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:07.418139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:07.419683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:07.464946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805c68-56db-4146-9cdd-95d3dd999aa7 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:07.500295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c4b0-70ce-4ffc-8b5b-b0fc9eddaa5b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:07.506443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:07.506609 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:07.506877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:07.507156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] PATH_INFO: `/v3/projects/fadcbdd1042e4040851fdc3585959eed` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:07.508343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadcbdd1042e4040851fdc3585959eed)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:07.510325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:07.532965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:07.533525 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:07.534226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:07.534529 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:07.534981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:07.536629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:07.547965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:07.550069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:07.559833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1245/2466] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:07.560656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:07.561885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:07.575805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db605972-a4c7-479c-a9cb-064caa8b32a7 service placement] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:07.580626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:07.581516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:07.581796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:07.582071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] PATH_INFO: `/v3/users/102a611e510d4087b09bf7206c2d302a` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:07.583291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=102a611e510d4087b09bf7206c2d302a)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:07.585202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:07.611157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadcbdd1042e4040851fdc3585959eed', 'request_id': 'req-8ad90f27-0a59-4cf8-bae8-949811c43546'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.616565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadcbdd1042e4040851fdc3585959eed', 'request_id': 'req-8ad90f27-0a59-4cf8-bae8-949811c43546'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.691170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadcbdd1042e4040851fdc3585959eed', 'request_id': 'req-8ad90f27-0a59-4cf8-bae8-949811c43546'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.702499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] The token cache is being invalidate because project fadcbdd1042e4040851fdc3585959eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:07.702809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.703421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8ad90f27-0a59-4cf8-bae8-949811c43546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.705468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1222/2467] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:07 2022] DELETE /identity/v3/projects/fadcbdd1042e4040851fdc3585959eed => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:07.711120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710745-f27c-46ec-baef-f189b2e06c1f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:07.711412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710745-f27c-46ec-baef-f189b2e06c1f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:07.711732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710745-f27c-46ec-baef-f189b2e06c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:07.739791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4a710745-f27c-46ec-baef-f189b2e06c1f None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:07.741780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4a710745-f27c-46ec-baef-f189b2e06c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:07.755169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102a611e510d4087b09bf7206c2d302a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.757502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:07.762839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102a611e510d4087b09bf7206c2d302a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.763540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102a611e510d4087b09bf7206c2d302a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.764196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102a611e510d4087b09bf7206c2d302a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.802105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1223/2468] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:07.810566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cf98-2bf2-43de-a048-6a2e4b1cf2e1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:07.810865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cf98-2bf2-43de-a048-6a2e4b1cf2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:07.811157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cf98-2bf2-43de-a048-6a2e4b1cf2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:07.829102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2074cf98-2bf2-43de-a048-6a2e4b1cf2e1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:07.830934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2074cf98-2bf2-43de-a048-6a2e4b1cf2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:07.832971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102a611e510d4087b09bf7206c2d302a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:07.840678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1224/2469] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:07.844538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cf98-2bf2-43de-a048-6a2e4b1cf2e1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:07.852504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1246/2470] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:07 2022] DELETE /identity/v3/users/102a611e510d4087b09bf7206c2d302a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:07.853263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cf98-2bf2-43de-a048-6a2e4b1cf2e1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:07.912437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:07.913116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:07.913405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:07.913686 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:07.914588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:07.915160 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:07.916551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:07.929308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1225/2471] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:50:07.933501 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:07.947805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f363d-4f48-46db-943a-30c1d983ffbf admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:07.949967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:07.951418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:07.951791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:07.952263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:07.952968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:07.955662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.058144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1247/2472] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:07 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:08.062363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.073756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a616a-fba7-416d-a4b6-99621a241caf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.108702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:08.132119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.132818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.133100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.133399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.134170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.136023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.146290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.148836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:08.163588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec04b-dcd3-4f9c-a9dc-38685e43bee9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.168928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.170303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.170589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.170875 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] PATH_INFO: `/v3/projects/1f7abd999daa4491867a3b27809b0317` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.172041 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7abd999daa4491867a3b27809b0317)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.174655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.243799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1226/2473] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:08.245714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.255740 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a64204-85da-4349-a402-e74adeb4c3f7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.260590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.261252 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.261538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.261825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.262577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.264191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.279513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1227/2474] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:08.289158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.299524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4fd33-a212-40f6-97e8-425fb8e77f1d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.305868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7abd999daa4491867a3b27809b0317', 'request_id': 'req-241aa3ee-1d9f-4689-8d31-003fcd427632'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:08.311756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7abd999daa4491867a3b27809b0317', 'request_id': 'req-241aa3ee-1d9f-4689-8d31-003fcd427632'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:08.364053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.364779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.365104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.365443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.366439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.368169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.379120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1228/2475] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:08.383449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.392879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af2f6-1626-4fe1-874f-5043dd5702b4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.397449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481a542-3865-4ed3-8d7b-a10b582b2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.406496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a542-3865-4ed3-8d7b-a10b582b2ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.406496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a542-3865-4ed3-8d7b-a10b582b2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.406496 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a542-3865-4ed3-8d7b-a10b582b2ded admin admin] PATH_INFO: `/v3/projects/98ad87610b6b43e2a756ea6169439620/users/60d771843770470a90c8f42c66a12fca/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.406862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7abd999daa4491867a3b27809b0317', 'request_id': 'req-241aa3ee-1d9f-4689-8d31-003fcd427632'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:08.412569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] The token cache is being invalidate because project 1f7abd999daa4491867a3b27809b0317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:08.412889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:08.413647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-241aa3ee-1d9f-4689-8d31-003fcd427632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:08.414036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481a542-3865-4ed3-8d7b-a10b582b2ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ad87610b6b43e2a756ea6169439620, user_id=60d771843770470a90c8f42c66a12fca, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.415491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1248/2476] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:08 2022] DELETE /identity/v3/projects/1f7abd999daa4491867a3b27809b0317 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:08.419939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481a542-3865-4ed3-8d7b-a10b582b2ded admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.420252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191cf4-1504-4068-8108-eb3f4c4bbd43 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.420548 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191cf4-1504-4068-8108-eb3f4c4bbd43 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.420858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191cf4-1504-4068-8108-eb3f4c4bbd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.440386 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-fb191cf4-1504-4068-8108-eb3f4c4bbd43 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:08.441596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fb191cf4-1504-4068-8108-eb3f4c4bbd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:08.449559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1249/2477] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:08.457200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b891f-fc05-4948-800e-c23f14f52230 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.457491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b891f-fc05-4948-800e-c23f14f52230 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.457772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b891f-fc05-4948-800e-c23f14f52230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.477258 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c45b891f-fc05-4948-800e-c23f14f52230 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:08.478488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c45b891f-fc05-4948-800e-c23f14f52230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:08.486935 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1250/2478] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:08.491064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b891f-fc05-4948-800e-c23f14f52230 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.500620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b891f-fc05-4948-800e-c23f14f52230 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.505824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.506495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.506779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.507053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.507788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:08.508075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.509654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.521480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1251/2479] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:50:08.525675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.535859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ceb2b-1048-483f-bb21-ecc7bd250f7a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.540419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.541042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.541326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.541602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.542311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.544189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.594076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1229/2480] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:08 2022] PUT /identity/v3/projects/98ad87610b6b43e2a756ea6169439620/users/60d771843770470a90c8f42c66a12fca/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:08.605793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.606112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.606447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.633696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] MFA Rules not processed for user `60d771843770470a90c8f42c66a12fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:08.634935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:08.687355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1252/2481] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:08.695492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.703890 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1230/2482] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:08.705607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.707625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:08.750234 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:08.770936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37316f4c-1a1c-4ea5-bcb1-1e6d956d691b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.775979 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.776772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.777122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.777408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.778103 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.780236 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.790885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b3f9b-eff7-4441-ae04-1273ad3ed7b3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.795600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.796259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.796541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.796816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.797504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.800091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.891364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1253/2483] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:08.895199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.904629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fee74-74fd-4d80-a1ca-2cfe5e590565 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:08.910092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:08.910803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:08.911090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:08.911376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:08.912106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:08.913777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:08.917431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:08.924950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1231/2484] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:08.928731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1254/2485] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:08.929051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.932310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:08.942241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e39b7-b562-47af-9ce7-c3b2028e8f7c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.004783 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5cabf-f755-47bc-92de-b55d277b3fdf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.006388 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.007064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.007349 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.007625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.008345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.009754 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.009982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.010468 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.010752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.011162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.011743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.013650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.020372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1255/2486] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:09.024481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.034946 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedce9-4559-42c5-9120-eab0ebf32f0b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.039509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c2715-d7ea-4d67-89f4-06462a3a7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.040405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2715-d7ea-4d67-89f4-06462a3a7ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.040699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2715-d7ea-4d67-89f4-06462a3a7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.040983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2715-d7ea-4d67-89f4-06462a3a7ddf admin admin] PATH_INFO: `/v3/projects/4eed21c42bde452aa4378a20fbd704d8/users/e3cae89625004034817bb93a6fc73bb6/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.055987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c2715-d7ea-4d67-89f4-06462a3a7ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eed21c42bde452aa4378a20fbd704d8, user_id=e3cae89625004034817bb93a6fc73bb6, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.058685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c2715-d7ea-4d67-89f4-06462a3a7ddf admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.085270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1232/2487] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:08 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:09.089796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.099942 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b683d-e57d-494d-816e-6f4f1949c89f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.104813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.105476 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.105764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.106065 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.106951 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.108556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.119887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1233/2488] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:09.126082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1256/2489] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:09 2022] PUT /identity/v3/projects/4eed21c42bde452aa4378a20fbd704d8/users/e3cae89625004034817bb93a6fc73bb6/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:09.135268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.136235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86126091-3efb-4640-b330-88eb3e882cc5 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.136769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86126091-3efb-4640-b330-88eb3e882cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.137054 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86126091-3efb-4640-b330-88eb3e882cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.151682 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c51d07-cb98-4bae-bc89-709e828c363c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.166833 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-86126091-3efb-4640-b330-88eb3e882cc5 None None] MFA Rules not processed for user `e3cae89625004034817bb93a6fc73bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:09.170880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-86126091-3efb-4640-b330-88eb3e882cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:09.223071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.223999 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.224304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.224593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] PATH_INFO: `/v3/projects/436b8804309c433f957cc7d2edf209ad/users/15e67ab3c4e84adda6f3bcfd3df54579/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.239175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1257/2490] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:09.244053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86126091-3efb-4640-b330-88eb3e882cc5 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.244182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436b8804309c433f957cc7d2edf209ad, user_id=15e67ab3c4e84adda6f3bcfd3df54579, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.246988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.263383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86126091-3efb-4640-b330-88eb3e882cc5 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.263383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.263383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.263383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.263785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.263785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.264303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.308559 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1234/2491] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:09 2022] PUT /identity/v3/projects/436b8804309c433f957cc7d2edf209ad/users/15e67ab3c4e84adda6f3bcfd3df54579/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:09.312893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.317522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:09.372137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:09.372895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fe4ce-e9d6-45a8-9e21-b7c4b8a8c394 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.378030 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.378726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.379108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.379386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.380127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.384605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1258/2492] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:09 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:09.384760 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.385665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.395753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1235/2493] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:09.397244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.410439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f422-f4cd-43d2-95ed-80e43fe5a09f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.454110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e810e1-5e3d-462d-9928-bad92b03c828 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.459078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.459749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.460037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.460363 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.461065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.463034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.465670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d47f-9bd1-4ac6-ac3d-0c20fca3dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.466628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d47f-9bd1-4ac6-ac3d-0c20fca3dbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.466914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d47f-9bd1-4ac6-ac3d-0c20fca3dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.467194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d47f-9bd1-4ac6-ac3d-0c20fca3dbfc admin admin] PATH_INFO: `/v3/projects/436b8804309c433f957cc7d2edf209ad/users/15e67ab3c4e84adda6f3bcfd3df54579/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.469153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d47f-9bd1-4ac6-ac3d-0c20fca3dbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=436b8804309c433f957cc7d2edf209ad, user_id=15e67ab3c4e84adda6f3bcfd3df54579, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.472430 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d47f-9bd1-4ac6-ac3d-0c20fca3dbfc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.483914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1236/2494] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:09 2022] PUT /identity/v3/projects/436b8804309c433f957cc7d2edf209ad/users/15e67ab3c4e84adda6f3bcfd3df54579/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:09.495236 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.495532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.495817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.522168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] MFA Rules not processed for user `15e67ab3c4e84adda6f3bcfd3df54579`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:09.523412 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:09.570950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1259/2495] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:09 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:09.574738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.584169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd4956-02d5-4c80-8887-f3727f098c27 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.595537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1237/2496] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:09.606995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.608389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:09.629950 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:09.642117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.642820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.643108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.643391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.644109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.645716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.655390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1260/2497] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:09.660372 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.665918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61387c1-1552-46ec-b663-983a9747e0b1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.669814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.670160 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5bc0-0aae-41a1-bb7b-9b1b344dd7f9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.670343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.670537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.670830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.675331 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.676223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.676507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.676831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] PATH_INFO: `/v3/projects/32f2036a35ec493a9deb4cbbd2842a55/users/7eb2ef4315a24a7694903a676d8a5e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.681253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.682728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.691887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f2036a35ec493a9deb4cbbd2842a55, user_id=7eb2ef4315a24a7694903a676d8a5e30, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.692464 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1238/2498] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:50:09.694565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.793878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1261/2499] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:09 2022] PUT /identity/v3/projects/32f2036a35ec493a9deb4cbbd2842a55/users/7eb2ef4315a24a7694903a676d8a5e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:09.797772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.809505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bdff-039d-4f61-a3d1-277c93362215 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.870122 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fbe1c-9690-48d0-967c-beea7c5d1576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.870824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fbe1c-9690-48d0-967c-beea7c5d1576 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.871109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fbe1c-9690-48d0-967c-beea7c5d1576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.871387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fbe1c-9690-48d0-967c-beea7c5d1576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.872098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fbe1c-9690-48d0-967c-beea7c5d1576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.873703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fbe1c-9690-48d0-967c-beea7c5d1576 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.883301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1239/2500] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:09.887446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:09.898505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368319d1-715f-46db-a6a8-b682ef6af96b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:09.903120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:09.903996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.904280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.904552 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] PATH_INFO: `/v3/projects/32f2036a35ec493a9deb4cbbd2842a55/users/7eb2ef4315a24a7694903a676d8a5e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.906805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f2036a35ec493a9deb4cbbd2842a55, user_id=7eb2ef4315a24a7694903a676d8a5e30, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:09.910082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:09.920862 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1262/2501] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:09 2022] PUT /identity/v3/projects/32f2036a35ec493a9deb4cbbd2842a55/users/7eb2ef4315a24a7694903a676d8a5e30/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:09.933702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:09.933702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:09.933702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:09.961939 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] MFA Rules not processed for user `7eb2ef4315a24a7694903a676d8a5e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:09.963216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:10.032088 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1240/2502] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:10.044111 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:10.097087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:10.102312 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dbd28-1e82-4c76-9acb-70a883771b8c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:10.105965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:10.106643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:10.106930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:10.107211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:10.116274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:10.117709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:10.128616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1263/2503] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:10.285003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:10.288205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:10.348275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:10.386479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb242-165d-4cec-bbd7-cea5a217ef64 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:10.410669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:10.411671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:10.422578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:10.422578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:10.422578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:10.444467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:10.446666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:10.471553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1241/2504] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:10.770302 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:10.851835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8121d3-6e14-474e-90c1-865450e3195e service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:10.857523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:10.858563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:10.861197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:10.861197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] PATH_INFO: `/v3/users/60d771843770470a90c8f42c66a12fca` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:10.861921 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d771843770470a90c8f42c66a12fca)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:10.864097 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:11.024453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d771843770470a90c8f42c66a12fca'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.032088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d771843770470a90c8f42c66a12fca'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.032681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d771843770470a90c8f42c66a12fca'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.033297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d771843770470a90c8f42c66a12fca'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.068229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:11.078570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20609f5d-a188-4e8b-abad-eacf38523aa1 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:11.083051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:11.083937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:11.084216 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:11.084491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] PATH_INFO: `/v3/users/e3cae89625004034817bb93a6fc73bb6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:11.085651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cae89625004034817bb93a6fc73bb6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:11.087587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:11.108015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c881ced4-936d-4f43-a810-65b10456a825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d771843770470a90c8f42c66a12fca'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.126487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1264/2505] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:10 2022] DELETE /identity/v3/users/60d771843770470a90c8f42c66a12fca => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:11.130843 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:11.131185 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:11.131470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:11.147708 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:11.148894 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:11.206592 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1265/2506] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:11.216143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:11.217424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:11.228346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:11.272391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22ea61-471e-4b16-8be0-33cf9a6846a8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:11.275985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b6154-f8d7-496a-a560-4b86c14c066e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:11.276626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6154-f8d7-496a-a560-4b86c14c066e service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:11.276907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6154-f8d7-496a-a560-4b86c14c066e service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:11.277180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6154-f8d7-496a-a560-4b86c14c066e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:11.288599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b6154-f8d7-496a-a560-4b86c14c066e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:11.290415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b6154-f8d7-496a-a560-4b86c14c066e service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:11.294940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cae89625004034817bb93a6fc73bb6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.301231 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1266/2507] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:11.302020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cae89625004034817bb93a6fc73bb6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.393989 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cae89625004034817bb93a6fc73bb6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.407888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cae89625004034817bb93a6fc73bb6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.408553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cae89625004034817bb93a6fc73bb6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.414803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1242/2508] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:11 2022] DELETE /identity/v3/users/e3cae89625004034817bb93a6fc73bb6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:11.419404 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:11.419729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:11.420013 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:11.437698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:11.439561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:11.498737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1267/2509] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:11.509046 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:11.510588 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:11.573993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3caef-5573-41ff-90ed-04d7ac7159ec admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:11.577614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bed7f-8658-41d6-8df8-e524066c3ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:11.578287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bed7f-8658-41d6-8df8-e524066c3ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:11.578573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bed7f-8658-41d6-8df8-e524066c3ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:11.578848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bed7f-8658-41d6-8df8-e524066c3ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:11.588330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bed7f-8658-41d6-8df8-e524066c3ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:11.589764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bed7f-8658-41d6-8df8-e524066c3ca2 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:11.600692 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1243/2510] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:50:11.728661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:11.730167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:11.769649 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e88dd-46a0-41de-8de6-9f660a1be064 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:11.775985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:11.776943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:11.777299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:11.777667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] PATH_INFO: `/v3/projects/98ad87610b6b43e2a756ea6169439620` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:11.779555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ad87610b6b43e2a756ea6169439620)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:11.781877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:11.880673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ad87610b6b43e2a756ea6169439620', 'request_id': 'req-e47b31ce-79f5-41ab-9461-fa53ae05bb05'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.902054 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:11.902674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:11.903257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:11.909777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ad87610b6b43e2a756ea6169439620', 'request_id': 'req-e47b31ce-79f5-41ab-9461-fa53ae05bb05'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:11.925603 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:11.926878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:11.967300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:11.981864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1244/2511] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 19 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:11.990425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:11.991512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:12.004788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ad87610b6b43e2a756ea6169439620', 'request_id': 'req-e47b31ce-79f5-41ab-9461-fa53ae05bb05'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.020954 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] The token cache is being invalidate because project 98ad87610b6b43e2a756ea6169439620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:12.021393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.022143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.026625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1268/2512] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:11 2022] DELETE /identity/v3/projects/98ad87610b6b43e2a756ea6169439620 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:12.026625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:12.027713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:12.063758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf93e5-4e62-4749-83d0-88fafd562b2d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:12.068404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:12.068973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:12.069429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:12.069528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:12.069795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] PATH_INFO: `/v3/projects/4eed21c42bde452aa4378a20fbd704d8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:12.071016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eed21c42bde452aa4378a20fbd704d8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:12.072919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:12.098617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b31ce-79f5-41ab-9461-fa53ae05bb05 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:12.103925 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:12.104589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:12.104870 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:12.105145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:12.107989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:12.119500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:12.121101 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:12.129544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1269/2513] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:50:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:50:12.130375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:12.131742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:12.145917 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117a00-6a27-43f2-a9a6-d950d041944d service swift] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:12.150473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:12.151328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:12.151613 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:12.151887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] PATH_INFO: `/v3/users/15e67ab3c4e84adda6f3bcfd3df54579` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:12.153107 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e67ab3c4e84adda6f3bcfd3df54579)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:12.155060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:12.185105 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eed21c42bde452aa4378a20fbd704d8', 'request_id': 'req-4e05e902-43e0-4014-a4e0-e741aabbda5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.193712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eed21c42bde452aa4378a20fbd704d8', 'request_id': 'req-4e05e902-43e0-4014-a4e0-e741aabbda5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.290601 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eed21c42bde452aa4378a20fbd704d8', 'request_id': 'req-4e05e902-43e0-4014-a4e0-e741aabbda5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.303255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] The token cache is being invalidate because project 4eed21c42bde452aa4378a20fbd704d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:12.303546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.304192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.305753 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1245/2514] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:11 2022] DELETE /identity/v3/projects/4eed21c42bde452aa4378a20fbd704d8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:12.309513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:12.310832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:12.376435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e902-43e0-4014-a4e0-e741aabbda5b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:12.381310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:12.382188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:12.382569 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:12.382850 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] PATH_INFO: `/v3/users/7eb2ef4315a24a7694903a676d8a5e30` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:12.384113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb2ef4315a24a7694903a676d8a5e30)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:12.386168 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:12.402509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e67ab3c4e84adda6f3bcfd3df54579'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.410820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:12.413303 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e67ab3c4e84adda6f3bcfd3df54579'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.414131 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e67ab3c4e84adda6f3bcfd3df54579'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.414996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e67ab3c4e84adda6f3bcfd3df54579'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.519191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e67ab3c4e84adda6f3bcfd3df54579'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.539439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1270/2515] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:12 2022] DELETE /identity/v3/users/15e67ab3c4e84adda6f3bcfd3df54579 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:12.607327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb2ef4315a24a7694903a676d8a5e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.615570 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb2ef4315a24a7694903a676d8a5e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.713639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb2ef4315a24a7694903a676d8a5e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.727786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb2ef4315a24a7694903a676d8a5e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.728463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb2ef4315a24a7694903a676d8a5e30'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:12.734567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1246/2516] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:12 2022] DELETE /identity/v3/users/7eb2ef4315a24a7694903a676d8a5e30 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:13.059554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.061169 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:13.147356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076c76-7db4-4de7-ac33-5ee3570a85f4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.194772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:13.206806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.207687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.207987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.208271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] PATH_INFO: `/v3/projects/436b8804309c433f957cc7d2edf209ad` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.209794 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] RBAC: Authorizing `identity:delete_project(project_id=436b8804309c433f957cc7d2edf209ad)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.211765 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.342509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436b8804309c433f957cc7d2edf209ad', 'request_id': 'req-a0959323-0657-454b-8561-55f4f359096f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.347841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436b8804309c433f957cc7d2edf209ad', 'request_id': 'req-a0959323-0657-454b-8561-55f4f359096f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.360978 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.363011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:13.379630 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f4b6-0cf1-4240-a26c-7df7b9a8df9b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.438770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.439634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.439917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.440191 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] PATH_INFO: `/v3/projects/32f2036a35ec493a9deb4cbbd2842a55` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.441372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f2036a35ec493a9deb4cbbd2842a55)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.443329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.468123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436b8804309c433f957cc7d2edf209ad', 'request_id': 'req-a0959323-0657-454b-8561-55f4f359096f'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.480556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] The token cache is being invalidate because project 436b8804309c433f957cc7d2edf209ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:13.480889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.481517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-a0959323-0657-454b-8561-55f4f359096f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.483112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1271/2517] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:13 2022] DELETE /identity/v3/projects/436b8804309c433f957cc7d2edf209ad => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:13.487793 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4915e-7fc4-4484-9ddb-9fe743ea8ac6 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.488086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4915e-7fc4-4484-9ddb-9fe743ea8ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.488367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4915e-7fc4-4484-9ddb-9fe743ea8ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.512944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-74a4915e-7fc4-4484-9ddb-9fe743ea8ac6 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:13.514183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-74a4915e-7fc4-4484-9ddb-9fe743ea8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:13.523544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1272/2518] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:13.531405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7315-769f-4078-aa18-6cec114fda2a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.531702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7315-769f-4078-aa18-6cec114fda2a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.531983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7315-769f-4078-aa18-6cec114fda2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.539656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f2036a35ec493a9deb4cbbd2842a55', 'request_id': 'req-fff424b5-36d8-4741-8980-6261885561ca'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.545067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f2036a35ec493a9deb4cbbd2842a55', 'request_id': 'req-fff424b5-36d8-4741-8980-6261885561ca'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.551711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a57a7315-769f-4078-aa18-6cec114fda2a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:13.552993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a57a7315-769f-4078-aa18-6cec114fda2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:13.587902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f2036a35ec493a9deb4cbbd2842a55', 'request_id': 'req-fff424b5-36d8-4741-8980-6261885561ca'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.600503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] The token cache is being invalidate because project 32f2036a35ec493a9deb4cbbd2842a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:13.601018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.601658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fff424b5-36d8-4741-8980-6261885561ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:13.603262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1247/2519] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:13 2022] DELETE /identity/v3/projects/32f2036a35ec493a9deb4cbbd2842a55 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:13.608026 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9e32f-8dfe-4183-9254-c447471d33b7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.608326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9e32f-8dfe-4183-9254-c447471d33b7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.608658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9e32f-8dfe-4183-9254-c447471d33b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.612774 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1273/2520] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:13.617810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7315-769f-4078-aa18-6cec114fda2a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.627775 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7315-769f-4078-aa18-6cec114fda2a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.629318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dfa9e32f-8dfe-4183-9254-c447471d33b7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:13.630629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dfa9e32f-8dfe-4183-9254-c447471d33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:13.632465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.633294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.633577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.633861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.634669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:13.634977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.636601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.638694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1248/2521] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:13.646301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4ce47-c533-4e07-9c82-3ebd666f88a5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.646594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4ce47-c533-4e07-9c82-3ebd666f88a5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.646874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4ce47-c533-4e07-9c82-3ebd666f88a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.648604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1274/2522] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:50:13.652799 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.662972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eda2fa-b236-4127-9448-04ee3232c302 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.664891 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c1f4ce47-c533-4e07-9c82-3ebd666f88a5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:13.666123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c1f4ce47-c533-4e07-9c82-3ebd666f88a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:13.667564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.668211 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.668500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.668781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.669521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.671460 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.674558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1249/2523] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:13.678972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4ce47-c533-4e07-9c82-3ebd666f88a5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.688120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4ce47-c533-4e07-9c82-3ebd666f88a5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.693279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.696945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.696945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.696945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.696945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:13.696945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.697361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.709017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1250/2524] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:50:13.713118 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.717902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:13.735960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abfa2a-7fcd-46b2-a64b-ca9bacbc1c18 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.735960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.735960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.735960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.736391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.736391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.736391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.760733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1275/2525] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:13.764699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.804281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:13.832932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1251/2526] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:13.834129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.838676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400d18b-36d5-4f62-bf29-1fe47608987b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.897689 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573ec3-c03b-4b30-b4e6-a96dad0cf26a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.901089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.901918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.902224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.902509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.903206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.904049 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.904837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.905139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.905239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.905408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.906387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:13.908800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:13.977347 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1276/2527] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:13.981221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.989541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1252/2528] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:13 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:13.992620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7393268-023f-4c4c-b3d5-3411610abac8 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:13.994069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:13.998600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:13.998600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:13.998600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:13.999300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:13.999606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.001352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.005424 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31cf50-793e-4d46-ba93-2df81fd9f833 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.010325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.010983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.011268 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.011546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.012306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.012612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1277/2529] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:14.013973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.016910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.024908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1253/2530] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:14.029131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.030379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d188-7df1-4fb1-8824-369c400d1ef8 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.039643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083003-c768-456b-b244-53776009fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.040391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083003-c768-456b-b244-53776009fd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.040678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083003-c768-456b-b244-53776009fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.040892 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612021d-91a2-41ab-9fb0-226218976b04 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.041023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083003-c768-456b-b244-53776009fd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.041671 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df083003-c768-456b-b244-53776009fd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.043307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df083003-c768-456b-b244-53776009fd60 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.050437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.051100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.051381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.051653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.052364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.053945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.059667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1278/2531] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:14.063299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083003-c768-456b-b244-53776009fd60 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.066255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1254/2532] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:14.069583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.075270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083003-c768-456b-b244-53776009fd60 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.080656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accd659-5c1f-4102-b2b6-597f6234e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.081198 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9bf2-4bf9-4872-9285-8360ef8c0ebf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.081538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd659-5c1f-4102-b2b6-597f6234e4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.081828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd659-5c1f-4102-b2b6-597f6234e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.082100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd659-5c1f-4102-b2b6-597f6234e4bc admin admin] PATH_INFO: `/v3/projects/94bc7fcf22cf46c4b60a3116abe31ab1/users/33b29e290c764e3b8fcff669d824e6f7/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.086115 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128af43-be9e-4308-a361-afa151eff144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.087022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128af43-be9e-4308-a361-afa151eff144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.087447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128af43-be9e-4308-a361-afa151eff144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.087717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128af43-be9e-4308-a361-afa151eff144 admin admin] PATH_INFO: `/v3/projects/09f0a0380cc441ab8daffbb48195792d/users/6adc3f0352b342d6877108b3a8b13cb8/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.099920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accd659-5c1f-4102-b2b6-597f6234e4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bc7fcf22cf46c4b60a3116abe31ab1, user_id=33b29e290c764e3b8fcff669d824e6f7, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.102623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accd659-5c1f-4102-b2b6-597f6234e4bc admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.104876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128af43-be9e-4308-a361-afa151eff144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f0a0380cc441ab8daffbb48195792d, user_id=6adc3f0352b342d6877108b3a8b13cb8, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.107728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128af43-be9e-4308-a361-afa151eff144 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.188301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1279/2533] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:14 2022] PUT /identity/v3/projects/94bc7fcf22cf46c4b60a3116abe31ab1/users/33b29e290c764e3b8fcff669d824e6f7/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:14.198336 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.198631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.198940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.199564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1255/2534] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:14 2022] PUT /identity/v3/projects/09f0a0380cc441ab8daffbb48195792d/users/6adc3f0352b342d6877108b3a8b13cb8/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:14.211370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10c67-ef77-4cb0-ae27-9f5fa12277a6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.211706 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10c67-ef77-4cb0-ae27-9f5fa12277a6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.211980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10c67-ef77-4cb0-ae27-9f5fa12277a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.225906 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] MFA Rules not processed for user `33b29e290c764e3b8fcff669d824e6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:14.227144 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:14.238776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ddd10c67-ef77-4cb0-ae27-9f5fa12277a6 None None] MFA Rules not processed for user `6adc3f0352b342d6877108b3a8b13cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:14.240250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ddd10c67-ef77-4cb0-ae27-9f5fa12277a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:14.295370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1280/2535] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:14.306863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.308232 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:14.309486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1256/2536] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:14.313774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10c67-ef77-4cb0-ae27-9f5fa12277a6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.322188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:14.326832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:14.368078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403325d6-296c-459a-8033-0dd2c1c9ae7e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.371858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.372507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.372792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.373073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.375111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10c67-ef77-4cb0-ae27-9f5fa12277a6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.379651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.380294 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.380579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.380849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.381537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.381747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.383448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.383776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.392923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1281/2537] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:50:14.475912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1257/2538] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:14 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:14.480215 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.492220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2db81-fcb9-4c6d-934d-a7d2b4516016 service glance] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.557790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.558622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.558913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.559188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.559884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.561914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.650997 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1282/2539] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:14 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:14.655250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.666708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5953b1-dbcd-4741-a348-e0b060948a58 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.671404 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.672063 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.674313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.674313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.674313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.675712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.686450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1258/2540] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:14.690515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.700584 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9079f-8884-4830-9a29-e7af95fdedef admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.705294 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.706243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.706507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.706792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] PATH_INFO: `/v3/projects/8ba480e80860426d842781c056df5936/users/c4ce45cefc834df1a98eecf59ede6ad9/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.722459 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba480e80860426d842781c056df5936, user_id=c4ce45cefc834df1a98eecf59ede6ad9, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.725198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.816634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1283/2541] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:14 2022] PUT /identity/v3/projects/8ba480e80860426d842781c056df5936/users/c4ce45cefc834df1a98eecf59ede6ad9/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:14.820619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.830544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff53e-b725-416d-aed4-294a89ab0c69 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.887717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ffce-d612-49ba-af49-ea8378888322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.888380 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ffce-d612-49ba-af49-ea8378888322 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.888667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ffce-d612-49ba-af49-ea8378888322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.888962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ffce-d612-49ba-af49-ea8378888322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.889697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59ffce-d612-49ba-af49-ea8378888322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.891323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59ffce-d612-49ba-af49-ea8378888322 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.902085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1259/2542] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:14.906667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:14.917575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288f4d-ea1a-4b1d-b6e5-24b0120f5995 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:14.922137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:14.923642 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.924142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.924422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] PATH_INFO: `/v3/projects/8ba480e80860426d842781c056df5936/users/c4ce45cefc834df1a98eecf59ede6ad9/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.926421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba480e80860426d842781c056df5936, user_id=c4ce45cefc834df1a98eecf59ede6ad9, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:14.929042 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:14.939247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1284/2543] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:14 2022] PUT /identity/v3/projects/8ba480e80860426d842781c056df5936/users/c4ce45cefc834df1a98eecf59ede6ad9/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:14.949363 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52207-2c69-4a22-bc3e-ed8ec464a2b1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:14.949656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52207-2c69-4a22-bc3e-ed8ec464a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:14.949965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52207-2c69-4a22-bc3e-ed8ec464a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:14.977791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d4e52207-2c69-4a22-bc3e-ed8ec464a2b1 None None] MFA Rules not processed for user `c4ce45cefc834df1a98eecf59ede6ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:14.979091 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d4e52207-2c69-4a22-bc3e-ed8ec464a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:15.047400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1260/2544] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:15.058439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:15.060005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:15.123640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728413-5bca-43dc-9e15-3b0dbfb8776c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:15.128202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f02d6e-d354-4bfa-acc0-807b207f7c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:15.128948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f02d6e-d354-4bfa-acc0-807b207f7c67 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:15.129279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f02d6e-d354-4bfa-acc0-807b207f7c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:15.129516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f02d6e-d354-4bfa-acc0-807b207f7c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:15.139480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f02d6e-d354-4bfa-acc0-807b207f7c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:15.141087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f02d6e-d354-4bfa-acc0-807b207f7c67 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:15.151530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1285/2545] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:15 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:17.867785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52207-2c69-4a22-bc3e-ed8ec464a2b1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:17.877525 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:17.933033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52207-2c69-4a22-bc3e-ed8ec464a2b1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:17.937663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:17.938592 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:17.938878 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:17.939159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] PATH_INFO: `/v3/users/6adc3f0352b342d6877108b3a8b13cb8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:17.940339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adc3f0352b342d6877108b3a8b13cb8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:17.945727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:18.134625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adc3f0352b342d6877108b3a8b13cb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:18.141863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adc3f0352b342d6877108b3a8b13cb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:18.227734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adc3f0352b342d6877108b3a8b13cb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:18.241025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adc3f0352b342d6877108b3a8b13cb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:18.249622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adc3f0352b342d6877108b3a8b13cb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:18.249622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1261/2546] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:17 2022] DELETE /identity/v3/users/6adc3f0352b342d6877108b3a8b13cb8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:18.252173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:18.253281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:18.253405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:18.271265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:18.272547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:18.279714 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:18.341175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1286/2547] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:18.350751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:18.353675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:18.413533 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa768708-9031-41a8-9df2-fce0082083dd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:18.417913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:18.417913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:18.418293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:18.419158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:18.431584 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:18.434385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:18.447876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1262/2548] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:18.836017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:18.837528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:18.851750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c614-8f55-473a-9731-bf57b8103df0 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:18.857124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:18.858666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:18.858967 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:18.859252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] PATH_INFO: `/v3/projects/09f0a0380cc441ab8daffbb48195792d` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:18.860652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f0a0380cc441ab8daffbb48195792d)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:18.871730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:18.965271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f0a0380cc441ab8daffbb48195792d', 'request_id': 'req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:18.970634 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f0a0380cc441ab8daffbb48195792d', 'request_id': 'req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.056436 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f0a0380cc441ab8daffbb48195792d', 'request_id': 'req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.068168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] The token cache is being invalidate because project 09f0a0380cc441ab8daffbb48195792d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:19.068477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.069086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.070648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1287/2549] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:18 2022] DELETE /identity/v3/projects/09f0a0380cc441ab8daffbb48195792d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:19.074599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:19.084884 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3c83-1303-44fa-9f98-e731d7269e6f service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:19.114571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:19.141403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:19.142298 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:19.142594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:19.142867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] PATH_INFO: `/v3/users/c4ce45cefc834df1a98eecf59ede6ad9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:19.144083 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ce45cefc834df1a98eecf59ede6ad9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:19.146058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:19.402309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ce45cefc834df1a98eecf59ede6ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.410486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ce45cefc834df1a98eecf59ede6ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.473629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ce45cefc834df1a98eecf59ede6ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.487397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ce45cefc834df1a98eecf59ede6ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.488185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f8abb173-d6ec-46a8-915c-fed9ca523f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ce45cefc834df1a98eecf59ede6ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:19.494811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1263/2550] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:19 2022] DELETE /identity/v3/users/c4ce45cefc834df1a98eecf59ede6ad9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:19.915558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:19.918514 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:19.932528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f014c-2ab6-446a-9a4c-98a70e7b0109 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:19.993411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:19.994319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:19.994606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:19.994888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] PATH_INFO: `/v3/projects/8ba480e80860426d842781c056df5936` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:19.996148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba480e80860426d842781c056df5936)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:19.998019 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:20.100361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:20.108448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba480e80860426d842781c056df5936', 'request_id': 'req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:20.114652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba480e80860426d842781c056df5936', 'request_id': 'req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:20.187887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba480e80860426d842781c056df5936', 'request_id': 'req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:20.201390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] The token cache is being invalidate because project 8ba480e80860426d842781c056df5936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:20.201390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:20.209700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5e9fe5f3-5a0c-44c4-be50-53c01686b1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:20.209700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1288/2551] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:19 2022] DELETE /identity/v3/projects/8ba480e80860426d842781c056df5936 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:20.209885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50012d-7cac-4efd-bf42-c2ada65ee200 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.209885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50012d-7cac-4efd-bf42-c2ada65ee200 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.209885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50012d-7cac-4efd-bf42-c2ada65ee200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.227572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9d50012d-7cac-4efd-bf42-c2ada65ee200 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:20.228796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9d50012d-7cac-4efd-bf42-c2ada65ee200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:20.290737 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1264/2552] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:20.298743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557608c-9ac0-4dc5-9f34-e802cc481668 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.299073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557608c-9ac0-4dc5-9f34-e802cc481668 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.299319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557608c-9ac0-4dc5-9f34-e802cc481668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.319608 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b557608c-9ac0-4dc5-9f34-e802cc481668 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:20.320821 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b557608c-9ac0-4dc5-9f34-e802cc481668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:20.329365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1289/2553] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:20.333775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50012d-7cac-4efd-bf42-c2ada65ee200 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:20.343567 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50012d-7cac-4efd-bf42-c2ada65ee200 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:20.348183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:20.348863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.349148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.349429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.350184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:20.350539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:20.352155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:20.364626 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1265/2554] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:50:20.369490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557608c-9ac0-4dc5-9f34-e802cc481668 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:20.380589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557608c-9ac0-4dc5-9f34-e802cc481668 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:20.385638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:20.386340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.386624 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.386895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.387583 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:20.389500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:20.482087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1290/2555] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:20 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:20.486313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:20.496466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238ee54-b49e-4490-8f7d-97b9167b7110 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:20.531488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:20.553930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:20.554627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.554920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.555192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.555937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:20.558393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:20.662616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1266/2556] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:20 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:20.666812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:20.677878 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c982f-e895-4216-89ce-b1b24f949b6e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:20.682748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:20.683442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.683738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.684027 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.684756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:20.686387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:20.699353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1291/2557] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:20.702371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:20.713117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652617d9-2f59-407e-9ee7-4236ad6bbab4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:20.717823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644d92a-902d-4f17-a7d5-79025dd57b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:20.718538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644d92a-902d-4f17-a7d5-79025dd57b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.719050 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644d92a-902d-4f17-a7d5-79025dd57b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.719501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644d92a-902d-4f17-a7d5-79025dd57b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.720546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644d92a-902d-4f17-a7d5-79025dd57b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:20.722159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644d92a-902d-4f17-a7d5-79025dd57b7e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:20.732941 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1267/2558] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:20.737242 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:20.748064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8717ba-7990-42e3-bdb0-61598aaf8fae admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:20.752615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:20.753595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.754411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.754694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] PATH_INFO: `/v3/projects/103828bce7fc4e1cb1730f08e060af1b/users/82d803e55f4041e399a96e50bab453a5/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.770412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] RBAC: Authorizing `identity:create_grant(project_id=103828bce7fc4e1cb1730f08e060af1b, user_id=82d803e55f4041e399a96e50bab453a5, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:20.775121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:20.880540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1292/2559] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:20 2022] PUT /identity/v3/projects/103828bce7fc4e1cb1730f08e060af1b/users/82d803e55f4041e399a96e50bab453a5/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:20.891854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46dbb-8db3-4d2d-a0da-1bdc25cdcdbb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:20.892147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46dbb-8db3-4d2d-a0da-1bdc25cdcdbb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:20.892427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46dbb-8db3-4d2d-a0da-1bdc25cdcdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:20.920582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-47a46dbb-8db3-4d2d-a0da-1bdc25cdcdbb None None] MFA Rules not processed for user `82d803e55f4041e399a96e50bab453a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:20.921799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-47a46dbb-8db3-4d2d-a0da-1bdc25cdcdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:20.986619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1268/2560] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:20.991307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:21.056940 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc42c6d-c13b-462a-aec7-a14d0014702d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:21.061913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:21.062628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.062928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.063245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.063949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:21.065855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:21.167324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1293/2561] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:20 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:21.171283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46dbb-8db3-4d2d-a0da-1bdc25cdcdbb None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:21.182514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46dbb-8db3-4d2d-a0da-1bdc25cdcdbb None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:21.240625 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:21.241305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.241495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.241757 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.242486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:21.244413 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:21.314097 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1269/2562] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:21 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:21.318711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:21.329522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4d8fe-5202-4fb4-83bb-41be41fbe6d7 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:21.335075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:21.335857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.336149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.336428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.337163 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:21.338977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:21.350180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1294/2563] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:21.354549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:21.365232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a83ea-3f0e-4fdb-a51f-a8227a6f20c9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:21.369915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:21.370840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.371125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.371399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] PATH_INFO: `/v3/projects/2aec44a74de1417799274d1ec6bb1a40/users/188ab52b49a04a748b9c352dd576fc93/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.386952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aec44a74de1417799274d1ec6bb1a40, user_id=188ab52b49a04a748b9c352dd576fc93, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:21.389648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:21.473977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1270/2564] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:21 2022] PUT /identity/v3/projects/2aec44a74de1417799274d1ec6bb1a40/users/188ab52b49a04a748b9c352dd576fc93/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:21.479176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:21.489173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202e1a8-2079-4ce8-8969-7e53a9aa3bc4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:21.524420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:21.548239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c086f3-15f3-4e7f-914f-23b8b0beb310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:21.548907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c086f3-15f3-4e7f-914f-23b8b0beb310 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.549190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c086f3-15f3-4e7f-914f-23b8b0beb310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.549463 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c086f3-15f3-4e7f-914f-23b8b0beb310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.550420 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c086f3-15f3-4e7f-914f-23b8b0beb310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:21.552066 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c086f3-15f3-4e7f-914f-23b8b0beb310 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:21.562383 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1295/2565] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:21.567728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:21.578193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b79e7-e860-469c-a6c0-b0e21c17afcf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:21.583408 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:21.584281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.584673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.584958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] PATH_INFO: `/v3/projects/2aec44a74de1417799274d1ec6bb1a40/users/188ab52b49a04a748b9c352dd576fc93/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.587229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aec44a74de1417799274d1ec6bb1a40, user_id=188ab52b49a04a748b9c352dd576fc93, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:21.590019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:21.595992 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:21.601439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1271/2566] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:21 2022] PUT /identity/v3/projects/2aec44a74de1417799274d1ec6bb1a40/users/188ab52b49a04a748b9c352dd576fc93/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:21.611742 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.612038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.612319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.640531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] MFA Rules not processed for user `188ab52b49a04a748b9c352dd576fc93`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:21.641885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:21.713743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1296/2567] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:21.725317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:21.727073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:21.786536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858a629-257b-498b-9be4-7c759b473589 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:21.792549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:21.793790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:21.793790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:21.794059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:21.866695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:21.868130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:21.877074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1272/2568] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:25.046515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:25.047919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:25.059938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819222-9521-48bf-a397-d2ac85bb9631 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:25.063453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d9d5b-2f87-4c73-810a-acd1fb1a8627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:25.064096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9d5b-2f87-4c73-810a-acd1fb1a8627 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:25.064382 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9d5b-2f87-4c73-810a-acd1fb1a8627 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:25.064664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9d5b-2f87-4c73-810a-acd1fb1a8627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:25.074046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d9d5b-2f87-4c73-810a-acd1fb1a8627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:25.075505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d9d5b-2f87-4c73-810a-acd1fb1a8627 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:25.085559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1297/2569] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:29.415611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:29.417034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:29.486528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792a38a-86e8-414b-b043-98ba72541d29 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:29.492238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:29.493147 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:29.493426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:29.493698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] PATH_INFO: `/v3/users/33b29e290c764e3b8fcff669d824e6f7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:29.494938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b29e290c764e3b8fcff669d824e6f7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:29.496862 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:29.687273 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b29e290c764e3b8fcff669d824e6f7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:29.692518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:29.694458 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b29e290c764e3b8fcff669d824e6f7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:29.793807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b29e290c764e3b8fcff669d824e6f7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:29.806880 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b29e290c764e3b8fcff669d824e6f7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:29.807546 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b29e290c764e3b8fcff669d824e6f7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:29.820501 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1273/2570] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:29 2022] DELETE /identity/v3/users/33b29e290c764e3b8fcff669d824e6f7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:29.824070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:29.824555 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:29.824676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:29.844456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:29.845648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:29.909061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1298/2571] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:29.919437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:29.920883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:29.980014 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44262874-7907-4b58-bc5d-ff7eac57bf66 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:29.983711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ba9a9-8558-4352-b3b7-52cb54e2a26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:29.984447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba9a9-8558-4352-b3b7-52cb54e2a26c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:29.984732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba9a9-8558-4352-b3b7-52cb54e2a26c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:29.985027 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba9a9-8558-4352-b3b7-52cb54e2a26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:29.994673 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ba9a9-8558-4352-b3b7-52cb54e2a26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:29.996116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ba9a9-8558-4352-b3b7-52cb54e2a26c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:30.005495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1274/2572] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:30.429530 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:30.431082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:30.445337 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d2a52-c316-454f-a9d0-aba65ff3b701 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:30.450432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:30.451835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:30.452123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:30.452570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] PATH_INFO: `/v3/projects/94bc7fcf22cf46c4b60a3116abe31ab1` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:30.453759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bc7fcf22cf46c4b60a3116abe31ab1)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:30.455761 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:30.569893 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:30.576728 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bc7fcf22cf46c4b60a3116abe31ab1', 'request_id': 'req-52d8b479-5f9b-4e6d-a99c-914164a1d72d'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:30.582193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bc7fcf22cf46c4b60a3116abe31ab1', 'request_id': 'req-52d8b479-5f9b-4e6d-a99c-914164a1d72d'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:30.650136 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bc7fcf22cf46c4b60a3116abe31ab1', 'request_id': 'req-52d8b479-5f9b-4e6d-a99c-914164a1d72d'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:30.661335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] The token cache is being invalidate because project 94bc7fcf22cf46c4b60a3116abe31ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:30.661667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:30.662329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-52d8b479-5f9b-4e6d-a99c-914164a1d72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:30.664424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1299/2573] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:30 2022] DELETE /identity/v3/projects/94bc7fcf22cf46c4b60a3116abe31ab1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:30.669383 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d70a-9e7b-4f87-9e4b-6aaf994fc057 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:30.669852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d70a-9e7b-4f87-9e4b-6aaf994fc057 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:30.670023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d70a-9e7b-4f87-9e4b-6aaf994fc057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:30.687304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9592d70a-9e7b-4f87-9e4b-6aaf994fc057 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:30.688475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9592d70a-9e7b-4f87-9e4b-6aaf994fc057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:30.746336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1275/2574] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:30.755108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b996-2905-4370-b55d-06eef48f0c3e None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:30.755422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b996-2905-4370-b55d-06eef48f0c3e None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:30.755703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b996-2905-4370-b55d-06eef48f0c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:30.774114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8701b996-2905-4370-b55d-06eef48f0c3e None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:30.775350 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8701b996-2905-4370-b55d-06eef48f0c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:30.783676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1300/2575] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:30.787826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592d70a-9e7b-4f87-9e4b-6aaf994fc057 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:30.798111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592d70a-9e7b-4f87-9e4b-6aaf994fc057 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:30.802723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:30.803375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:30.803702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:30.803983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:30.804733 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:30.805042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:30.806709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:30.818485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1276/2576] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:50:30.822861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b996-2905-4370-b55d-06eef48f0c3e None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:30.832458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b996-2905-4370-b55d-06eef48f0c3e None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:30.840365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:30.842040 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:30.842366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:30.842656 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:30.843387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:30.845307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:30.937772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1301/2577] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:30 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:30.942021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:30.952545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965567-d259-445a-a21d-5c11f8f05a2f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:31.013151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:31.013956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:31.014400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:31.014683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:31.015505 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:31.017295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:31.026818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:31.113728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1277/2578] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:30 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:31.117859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:31.128576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462e2e8-445a-42f7-b579-a412c2f6c589 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:31.133980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:31.137767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:31.137767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:31.137767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:31.137767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:31.137767 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:31.148248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1302/2579] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:31.152081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:31.163119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1a31-8e1c-4f4e-86eb-abe781e5565f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:31.167751 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7628b0-e5ca-45a1-942d-c1ebfa512533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:31.168403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7628b0-e5ca-45a1-942d-c1ebfa512533 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:31.168690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7628b0-e5ca-45a1-942d-c1ebfa512533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:31.169012 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7628b0-e5ca-45a1-942d-c1ebfa512533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:31.169764 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7628b0-e5ca-45a1-942d-c1ebfa512533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:31.171456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7628b0-e5ca-45a1-942d-c1ebfa512533 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:31.182145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1278/2580] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:31.185913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:31.196651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa00d7-86ea-43f8-b8d7-21b5f125c0a0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:31.201361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:31.206645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:31.206645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:31.206645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] PATH_INFO: `/v3/projects/9398367b26ff4824a5e0dc02c92a238e/users/8caf5231ed724d85a9b1afd0a109d711/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:31.217697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9398367b26ff4824a5e0dc02c92a238e, user_id=8caf5231ed724d85a9b1afd0a109d711, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:31.220355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:31.290831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1303/2581] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:31 2022] PUT /identity/v3/projects/9398367b26ff4824a5e0dc02c92a238e/users/8caf5231ed724d85a9b1afd0a109d711/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:31.301309 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:31.301624 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:31.301902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:31.328472 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] MFA Rules not processed for user `8caf5231ed724d85a9b1afd0a109d711`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:31.329670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:31.391868 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1279/2582] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:31.403170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:31.413955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:31.466520 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728890ca-9db2-478d-bda6-5f7e52fb7d26 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:31.470434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53958a8d-60a1-4308-bcf7-0771564c90fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:31.471127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958a8d-60a1-4308-bcf7-0771564c90fa service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:31.471453 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958a8d-60a1-4308-bcf7-0771564c90fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:31.471837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958a8d-60a1-4308-bcf7-0771564c90fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:31.480508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53958a8d-60a1-4308-bcf7-0771564c90fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:31.481934 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53958a8d-60a1-4308-bcf7-0771564c90fa service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:31.490788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1304/2583] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:39.768377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:39.769926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:39.834302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5004f-7aa2-4535-b870-4e9461dd8dda None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:39.839377 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:39.840231 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:39.840521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:39.840800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] PATH_INFO: `/v3/users/82d803e55f4041e399a96e50bab453a5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:39.841974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d803e55f4041e399a96e50bab453a5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:39.844011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:40.018963 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d803e55f4041e399a96e50bab453a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.026618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d803e55f4041e399a96e50bab453a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.078449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d803e55f4041e399a96e50bab453a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.085675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:40.091510 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d803e55f4041e399a96e50bab453a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.092157 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d803e55f4041e399a96e50bab453a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.097917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1280/2584] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:39 2022] DELETE /identity/v3/users/82d803e55f4041e399a96e50bab453a5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:40.102521 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:40.103001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:40.103105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:40.120213 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:40.121405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:40.173217 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:40.182473 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1305/2585] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:40.192103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:40.193492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:40.251954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b877da-d31a-42c6-99c6-fade12f3f1aa admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:40.255558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:40.256199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:40.256482 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:40.256759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:40.266406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:40.267838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:40.277422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1281/2586] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:40.697672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:40.701502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:40.711498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36d37-8151-4510-975b-f9a008aa67c8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:40.716475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:40.717424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:40.717783 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:40.718134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] PATH_INFO: `/v3/projects/103828bce7fc4e1cb1730f08e060af1b` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:40.719563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] RBAC: Authorizing `identity:delete_project(project_id=103828bce7fc4e1cb1730f08e060af1b)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:40.721670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:40.863540 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103828bce7fc4e1cb1730f08e060af1b', 'request_id': 'req-700a6126-57c0-481c-9dd6-1db43b52d29e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.869809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103828bce7fc4e1cb1730f08e060af1b', 'request_id': 'req-700a6126-57c0-481c-9dd6-1db43b52d29e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.959361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103828bce7fc4e1cb1730f08e060af1b', 'request_id': 'req-700a6126-57c0-481c-9dd6-1db43b52d29e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.971776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] The token cache is being invalidate because project 103828bce7fc4e1cb1730f08e060af1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:40.972073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.972698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:40.974289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1306/2587] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:40 2022] DELETE /identity/v3/projects/103828bce7fc4e1cb1730f08e060af1b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:40.978248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:40.988660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8d08-0638-4ce9-b61f-19f3757dd858 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:41.046713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:41.047687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:41.047979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:41.048259 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] PATH_INFO: `/v3/users/188ab52b49a04a748b9c352dd576fc93` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:41.049440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188ab52b49a04a748b9c352dd576fc93)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:41.051401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:41.230022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188ab52b49a04a748b9c352dd576fc93'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:41.237141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188ab52b49a04a748b9c352dd576fc93'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:41.301853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188ab52b49a04a748b9c352dd576fc93'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:41.315366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188ab52b49a04a748b9c352dd576fc93'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:41.316034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7f1ea0f7-a44d-4441-908a-68ae4d43ab89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188ab52b49a04a748b9c352dd576fc93'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:41.322734 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1282/2588] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:40 2022] DELETE /identity/v3/users/188ab52b49a04a748b9c352dd576fc93 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:41.709268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:41.710718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:41.725901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6126-57c0-481c-9dd6-1db43b52d29e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:41.784000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:41.784830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:41.785115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:41.785393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] PATH_INFO: `/v3/projects/2aec44a74de1417799274d1ec6bb1a40` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:41.786602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aec44a74de1417799274d1ec6bb1a40)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:41.788495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:41.902081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aec44a74de1417799274d1ec6bb1a40', 'request_id': 'req-b2c6297e-765f-43d3-8e1a-18d43cc39b41'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:41.908068 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aec44a74de1417799274d1ec6bb1a40', 'request_id': 'req-b2c6297e-765f-43d3-8e1a-18d43cc39b41'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:42.010950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aec44a74de1417799274d1ec6bb1a40', 'request_id': 'req-b2c6297e-765f-43d3-8e1a-18d43cc39b41'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:42.022090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] The token cache is being invalidate because project 2aec44a74de1417799274d1ec6bb1a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:42.022800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:42.023078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-b2c6297e-765f-43d3-8e1a-18d43cc39b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:42.024606 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1307/2589] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:41 2022] DELETE /identity/v3/projects/2aec44a74de1417799274d1ec6bb1a40 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:42.029461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983b67a-0ac6-4b09-b3a5-d43bb0a4ad94 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.029943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983b67a-0ac6-4b09-b3a5-d43bb0a4ad94 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.030059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983b67a-0ac6-4b09-b3a5-d43bb0a4ad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.047199 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0983b67a-0ac6-4b09-b3a5-d43bb0a4ad94 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:42.048310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0983b67a-0ac6-4b09-b3a5-d43bb0a4ad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:42.053452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:42.106997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1283/2590] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:42.116128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0716-3d7e-443c-9cfe-1b8d4df680e0 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.116422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0716-3d7e-443c-9cfe-1b8d4df680e0 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.116707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0716-3d7e-443c-9cfe-1b8d4df680e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.135348 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-69bc0716-3d7e-443c-9cfe-1b8d4df680e0 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:42.136542 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-69bc0716-3d7e-443c-9cfe-1b8d4df680e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:42.144497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1308/2591] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:42.148707 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983b67a-0ac6-4b09-b3a5-d43bb0a4ad94 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.158641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983b67a-0ac6-4b09-b3a5-d43bb0a4ad94 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:42.163964 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:42.164613 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.164926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.165205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.166452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:42.166770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:42.168370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:42.179763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1284/2592] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:50:42.184528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc0716-3d7e-443c-9cfe-1b8d4df680e0 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.190055 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:42.193663 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc0716-3d7e-443c-9cfe-1b8d4df680e0 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:42.198256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:42.198902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.199195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.199471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.200164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:42.202065 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:42.337754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1309/2593] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:42 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:42.341792 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.352100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc6735-57a9-408d-be51-26b7eb89a809 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:42.410382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:42.411071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.411350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.411629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.412342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:42.414387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:42.582479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1285/2594] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:42 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:42.586450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.597156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6957e3-4445-42ca-94c1-34c30a4a4a39 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:42.601517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:42.602162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.602474 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.603720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.603720 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:42.605067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:42.615447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1310/2595] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:42.619614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.631498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c83d-c375-40fe-95b9-9b179cbb814a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:42.636134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6cf46-c3b1-4ce1-8abf-2e76234276fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:42.636790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6cf46-c3b1-4ce1-8abf-2e76234276fe admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.637076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6cf46-c3b1-4ce1-8abf-2e76234276fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.637355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6cf46-c3b1-4ce1-8abf-2e76234276fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.638106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6cf46-c3b1-4ce1-8abf-2e76234276fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:42.639743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6cf46-c3b1-4ce1-8abf-2e76234276fe admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:42.649765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1286/2596] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:42.654503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.664562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159949e-f1a8-4736-8c12-ae27e5e126d0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:42.669890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:42.670803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.671122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.671403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] PATH_INFO: `/v3/projects/bea667be3f904525a7f8274b4a741ddb/users/7397fc4be47a4459b4a54a69936baeb0/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.689816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea667be3f904525a7f8274b4a741ddb, user_id=7397fc4be47a4459b4a54a69936baeb0, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:42.692532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:42.770702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1311/2597] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:42 2022] PUT /identity/v3/projects/bea667be3f904525a7f8274b4a741ddb/users/7397fc4be47a4459b4a54a69936baeb0/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:42.781574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778783-6505-4b77-b508-30510a9772be None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.781881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778783-6505-4b77-b508-30510a9772be None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.782164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778783-6505-4b77-b508-30510a9772be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.808436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ce778783-6505-4b77-b508-30510a9772be None None] MFA Rules not processed for user `7397fc4be47a4459b4a54a69936baeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:42.809699 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ce778783-6505-4b77-b508-30510a9772be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:42.872842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1287/2598] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:42.877263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.923809 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce778783-6505-4b77-b508-30510a9772be None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:42.925283 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ce778783-6505-4b77-b508-30510a9772be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:42.934793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:42.952425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc11d-7a7f-4462-b262-4b2778395648 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:42.957857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:42.958759 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:42.958908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:42.959157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:42.959865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:42.961825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.001986 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce778783-6505-4b77-b508-30510a9772be None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.006541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.007401 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.007681 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.007955 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] PATH_INFO: `/v3/users/8caf5231ed724d85a9b1afd0a109d711` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.009153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8caf5231ed724d85a9b1afd0a109d711)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.011122 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.043496 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1312/2599] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:42 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:43.044518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.105172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5fade-1162-4bd7-8bd0-d066dda26df9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.110005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.110707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.110992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.111300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.112088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.114129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.195060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8caf5231ed724d85a9b1afd0a109d711'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:43.202343 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8caf5231ed724d85a9b1afd0a109d711'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:43.215963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1313/2600] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:43 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:43.219953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.229446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db38cf6-0753-4e76-9034-d3e63ea8836a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.234050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.234744 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.235030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.235315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.236024 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.237670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.248646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1314/2601] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:50:43.251831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.261134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca4f9-79e4-4bd1-bc64-888bf8141e14 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.265352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8caf5231ed724d85a9b1afd0a109d711'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:43.266543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.267395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.267699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.268113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] PATH_INFO: `/v3/projects/53127d5aaff6446c9ffc2fded86223cf/users/5976d25320584133a2d53a0d81408f46/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.275912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8caf5231ed724d85a9b1afd0a109d711'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:43.276859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06841f43-8497-4937-968c-399339c5e14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8caf5231ed724d85a9b1afd0a109d711'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:43.277270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:43.284920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53127d5aaff6446c9ffc2fded86223cf, user_id=5976d25320584133a2d53a0d81408f46, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.285044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1288/2602] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:42 2022] DELETE /identity/v3/users/8caf5231ed724d85a9b1afd0a109d711 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:43.287531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.288916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.289227 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.289509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.306150 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:43.307378 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.368956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1289/2603] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:43.377553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1315/2604] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:43 2022] PUT /identity/v3/projects/53127d5aaff6446c9ffc2fded86223cf/users/5976d25320584133a2d53a0d81408f46/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:43.379360 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.380919 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.381143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.382819 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.412243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:43.440221 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec53ed-05b1-4a42-8ed9-44bd3b92b015 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.447621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554e04-6319-4ad9-98fa-ea0f24ff1713 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.452883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.454330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.454330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.454330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.454818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.456421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.466323 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1316/2605] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:43.470502 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.480170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c4ced-d891-4d99-bc37-9f46d5844708 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.485550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf6f4d-d7a5-4f54-ad69-edab39e210cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.486450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf6f4d-d7a5-4f54-ad69-edab39e210cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.486740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf6f4d-d7a5-4f54-ad69-edab39e210cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.487017 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf6f4d-d7a5-4f54-ad69-edab39e210cb admin admin] PATH_INFO: `/v3/projects/53127d5aaff6446c9ffc2fded86223cf/users/5976d25320584133a2d53a0d81408f46/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.489045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf6f4d-d7a5-4f54-ad69-edab39e210cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53127d5aaff6446c9ffc2fded86223cf, user_id=5976d25320584133a2d53a0d81408f46, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.491190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.491715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf6f4d-d7a5-4f54-ad69-edab39e210cb admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.491837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.492127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.492399 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.502652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1317/2606] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:43 2022] PUT /identity/v3/projects/53127d5aaff6446c9ffc2fded86223cf/users/5976d25320584133a2d53a0d81408f46/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:43.503004 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.504455 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.512571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.512861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.513320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.514597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1290/2607] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:43.539435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] MFA Rules not processed for user `5976d25320584133a2d53a0d81408f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:43.540644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.611106 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1318/2608] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:50:43.622749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.624171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.679994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b002bb-3efe-477b-994f-35f6bc90a41e service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.734242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.734918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.735205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.735489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.746035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.748194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.759038 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1291/2609] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:43.890590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.891973 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.904314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d9b7-ad43-4755-8db4-5d930a25bd55 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:43.908339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6c4e6-a48a-4ff8-8e4c-96bddfa0405d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:43.909010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6c4e6-a48a-4ff8-8e4c-96bddfa0405d service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:43.909334 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6c4e6-a48a-4ff8-8e4c-96bddfa0405d service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:43.909747 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6c4e6-a48a-4ff8-8e4c-96bddfa0405d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:43.911458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4ec6c4e6-a48a-4ff8-8e4c-96bddfa0405d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.942615 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:43.943985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:43.970499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:43.974368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6c4e6-a48a-4ff8-8e4c-96bddfa0405d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:43.979394 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6c4e6-a48a-4ff8-8e4c-96bddfa0405d service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:43.985597 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1319/2610] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:44.003315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:44.021352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f2ee3-8a4b-428b-85d0-5fa78b60f87c service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:44.026299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:44.027031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.027317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.027596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] PATH_INFO: `/v3/projects/9398367b26ff4824a5e0dc02c92a238e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.029445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9398367b26ff4824a5e0dc02c92a238e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:44.031721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:44.115762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9398367b26ff4824a5e0dc02c92a238e', 'request_id': 'req-a08d70f0-0240-4cb1-bf37-cf2662863ad0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:44.121438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9398367b26ff4824a5e0dc02c92a238e', 'request_id': 'req-a08d70f0-0240-4cb1-bf37-cf2662863ad0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:44.181709 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9398367b26ff4824a5e0dc02c92a238e', 'request_id': 'req-a08d70f0-0240-4cb1-bf37-cf2662863ad0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:44.193975 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] The token cache is being invalidate because project 9398367b26ff4824a5e0dc02c92a238e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:44.194284 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:44.194911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a08d70f0-0240-4cb1-bf37-cf2662863ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:44.196548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1292/2611] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:43 2022] DELETE /identity/v3/projects/9398367b26ff4824a5e0dc02c92a238e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:44.201834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017408e-9234-4ee4-8abd-c1c146aaf865 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.202130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017408e-9234-4ee4-8abd-c1c146aaf865 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.202446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017408e-9234-4ee4-8abd-c1c146aaf865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.220391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-9017408e-9234-4ee4-8abd-c1c146aaf865 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:44.221585 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9017408e-9234-4ee4-8abd-c1c146aaf865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:44.282113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1320/2612] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:44.291536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dec69-7d5e-47ed-9f7c-1fc8d6e1b5a4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.291932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dec69-7d5e-47ed-9f7c-1fc8d6e1b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.292310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dec69-7d5e-47ed-9f7c-1fc8d6e1b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.313556 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c78dec69-7d5e-47ed-9f7c-1fc8d6e1b5a4 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:44.316405 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c78dec69-7d5e-47ed-9f7c-1fc8d6e1b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:44.322920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1293/2613] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:44.327731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017408e-9234-4ee4-8abd-c1c146aaf865 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:44.337537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017408e-9234-4ee4-8abd-c1c146aaf865 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:44.342910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:44.345423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.345423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.345423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.346191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:44.346541 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:44.348151 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:44.362028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1321/2614] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:50:44.367767 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dec69-7d5e-47ed-9f7c-1fc8d6e1b5a4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:44.377093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dec69-7d5e-47ed-9f7c-1fc8d6e1b5a4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:44.381906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:44.382586 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.382875 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.383152 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.383883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:44.385845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:44.503379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1294/2615] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:44 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:44.507638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:44.518087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7e5a0-48c1-406a-b62b-01aacfa7b193 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:44.573295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:44.573883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.574164 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.574511 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.575207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:44.577612 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:44.691464 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1322/2616] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:44 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:44.697177 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:44.707921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5637-dc4d-40ba-be8c-f3b4ccbc43ec admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:44.712438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:44.713087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.713369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.713642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.714386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:44.716069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:44.726438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1295/2617] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:44.733402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:44.743756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032402-daff-4ee1-803f-098220756efa admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:44.749198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b107c3-37de-4376-8e79-c443cd1750e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:44.749868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b107c3-37de-4376-8e79-c443cd1750e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.750149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b107c3-37de-4376-8e79-c443cd1750e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.750456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b107c3-37de-4376-8e79-c443cd1750e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.751178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b107c3-37de-4376-8e79-c443cd1750e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:44.752808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b107c3-37de-4376-8e79-c443cd1750e3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:44.763379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1323/2618] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:44.767923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:44.778008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43f10-8104-45c9-b717-a46dc8c424bc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:44.783136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:44.786071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.786071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.786071 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] PATH_INFO: `/v3/projects/be746dfba6514b3e9d9e27f794f68196/users/a74caf83bb2642059665cde2cf6112b6/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.799335 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be746dfba6514b3e9d9e27f794f68196, user_id=a74caf83bb2642059665cde2cf6112b6, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:44.801974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:44.867685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1296/2619] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:44 2022] PUT /identity/v3/projects/be746dfba6514b3e9d9e27f794f68196/users/a74caf83bb2642059665cde2cf6112b6/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:44.873387 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:44.873689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:44.873974 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:44.892249 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:44.893442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:44.949057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:44.963972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1324/2620] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:44.971786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:44.973529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:45.030295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989ebdc-9ed4-4548-a9a4-471c4ac040eb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:45.034428 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7659d30-f719-45d9-8dde-2c18f95ee61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:45.035087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659d30-f719-45d9-8dde-2c18f95ee61f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:45.035354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659d30-f719-45d9-8dde-2c18f95ee61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:45.035632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659d30-f719-45d9-8dde-2c18f95ee61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:45.045448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7659d30-f719-45d9-8dde-2c18f95ee61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:45.046926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7659d30-f719-45d9-8dde-2c18f95ee61f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:45.056513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1297/2621] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:49.243758 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:49.245276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:49.261770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2310-9546-42ae-a8c5-4dcbcb6a816d None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:49.269325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:49.270737 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:49.271499 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:49.272004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] PATH_INFO: `/v3/users/7397fc4be47a4459b4a54a69936baeb0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:49.274073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7397fc4be47a4459b4a54a69936baeb0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:49.277063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:49.459176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7397fc4be47a4459b4a54a69936baeb0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:49.466180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7397fc4be47a4459b4a54a69936baeb0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:49.466896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7397fc4be47a4459b4a54a69936baeb0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:49.467527 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7397fc4be47a4459b4a54a69936baeb0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:49.571076 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7397fc4be47a4459b4a54a69936baeb0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:49.597760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1325/2622] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:49 2022] DELETE /identity/v3/users/7397fc4be47a4459b4a54a69936baeb0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:49.602099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:49.602620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:49.603285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:49.623287 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:49.624620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:49.639293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:49.702196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1298/2623] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:49.711709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:49.713172 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:49.774123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377479e-2933-4a37-9447-8648db69af8b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:49.778978 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:49.780288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:49.784837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:49.784837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:49.793503 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:49.795547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:49.809037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1326/2624] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:50.571479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:50.574431 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:50.600509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86392ff-5465-4a9b-bd24-ba95bc124bf6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:50.619983 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:50.620937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:50.621325 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:50.621493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] PATH_INFO: `/v3/projects/bea667be3f904525a7f8274b4a741ddb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:50.624980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea667be3f904525a7f8274b4a741ddb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:50.629579 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:50.805900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea667be3f904525a7f8274b4a741ddb', 'request_id': 'req-647a1362-5a7a-4545-a9ab-7b0613188675'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:50.835208 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea667be3f904525a7f8274b4a741ddb', 'request_id': 'req-647a1362-5a7a-4545-a9ab-7b0613188675'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:50.939425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea667be3f904525a7f8274b4a741ddb', 'request_id': 'req-647a1362-5a7a-4545-a9ab-7b0613188675'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:50.976255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] The token cache is being invalidate because project bea667be3f904525a7f8274b4a741ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:50.976255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:50.978736 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-647a1362-5a7a-4545-a9ab-7b0613188675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:50.986810 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1299/2625] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:50 2022] DELETE /identity/v3/projects/bea667be3f904525a7f8274b4a741ddb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:50.988796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:51.017659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db75d0-2531-4f38-ba48-7416ed65a47d service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:51.125189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:51.126328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:51.126615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:51.126894 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] PATH_INFO: `/v3/users/5976d25320584133a2d53a0d81408f46` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:51.128392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5976d25320584133a2d53a0d81408f46)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:51.132311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:51.154570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:51.379660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5976d25320584133a2d53a0d81408f46'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:51.386700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5976d25320584133a2d53a0d81408f46'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:51.387403 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5976d25320584133a2d53a0d81408f46'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:51.388948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5976d25320584133a2d53a0d81408f46'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:51.508575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5976d25320584133a2d53a0d81408f46'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:51.533818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1327/2626] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:50:50 2022] DELETE /identity/v3/users/5976d25320584133a2d53a0d81408f46 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:52.155176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.156288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.156573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.188855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] MFA Rules not processed for user `a74caf83bb2642059665cde2cf6112b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:52.193031 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:52.269948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1300/2627] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:52.274640 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.276088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:52.303370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.304914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:52.348648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:52.371092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fd944-951d-4dbb-9329-b97a5f3fd787 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:52.375650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:52.377067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.377560 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.377943 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.378950 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:52.382006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:52.406848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958727c6-464e-44a2-822b-cfe918f1a41d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:52.412402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:52.413503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.413834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.414126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] PATH_INFO: `/v3/projects/53127d5aaff6446c9ffc2fded86223cf` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.415434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53127d5aaff6446c9ffc2fded86223cf)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:52.417508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:52.498266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1328/2628] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:52 2022] POST /identity/v3/projects => generated 371 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:52.503523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.546385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53127d5aaff6446c9ffc2fded86223cf', 'request_id': 'req-2828cb56-6530-4f40-a627-80ec5586972f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:52.553388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53127d5aaff6446c9ffc2fded86223cf', 'request_id': 'req-2828cb56-6530-4f40-a627-80ec5586972f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:52.580650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfb1ef-fe94-4fb6-8cb7-bf3b2e4ab0c3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:52.608195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:52.640102 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53127d5aaff6446c9ffc2fded86223cf', 'request_id': 'req-2828cb56-6530-4f40-a627-80ec5586972f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:52.641171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:52.642082 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.642454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.642812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.643582 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:52.645564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:52.653069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] The token cache is being invalidate because project 53127d5aaff6446c9ffc2fded86223cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:50:52.653357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:52.654645 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2828cb56-6530-4f40-a627-80ec5586972f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:50:52.659990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1301/2629] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:50:52 2022] DELETE /identity/v3/projects/53127d5aaff6446c9ffc2fded86223cf => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:52.665960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e3c2-1f85-4872-8a6d-4f7419e93fe1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.666288 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e3c2-1f85-4872-8a6d-4f7419e93fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.666574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e3c2-1f85-4872-8a6d-4f7419e93fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.696429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d869e3c2-1f85-4872-8a6d-4f7419e93fe1 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:52.697641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d869e3c2-1f85-4872-8a6d-4f7419e93fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:52.706722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1302/2630] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:52.715554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2eeb-f258-44ef-ad86-341708f73922 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.715851 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2eeb-f258-44ef-ad86-341708f73922 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.716140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2eeb-f258-44ef-ad86-341708f73922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.735471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-956f2eeb-f258-44ef-ad86-341708f73922 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:52.736450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-956f2eeb-f258-44ef-ad86-341708f73922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:52.737176 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1329/2631] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:52 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:52.741726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.744173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:52.750637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1303/2632] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:52.752272 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f2eeb-f258-44ef-ad86-341708f73922 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.756124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835d84-9958-4672-8c9f-26208c435e25 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:52.761653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f2eeb-f258-44ef-ad86-341708f73922 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:52.763884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:52.764556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.764885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.765146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.765865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:52.767581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:52.767729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:52.768334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.768617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.768897 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.769622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:50:52.769936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:52.771623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:52.783428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1330/2633] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:52.785307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.788797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1304/2634] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:50:52.789619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.798994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02f21-a3b1-4505-beee-8bcac88bd511 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:52.799591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93660a-0c65-4131-badb-5d03a8d5f1b7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:52.804720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:52.805371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.805545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:52.805680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.805918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.806649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:52.806792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:52.807147 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:52.807534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] PATH_INFO: `/v3/projects/73bf605cdb21473d87a7d7d32c29fd35/users/9e36da7c77984469a2668c0c8c2460ff/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:52.808784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:52.823932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bf605cdb21473d87a7d7d32c29fd35, user_id=9e36da7c77984469a2668c0c8c2460ff, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:52.827153 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:52.925486 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1305/2635] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:52 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:52.929911 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:52.944956 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1331/2636] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:52 2022] PUT /identity/v3/projects/73bf605cdb21473d87a7d7d32c29fd35/users/9e36da7c77984469a2668c0c8c2460ff/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:52.949590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:53.046792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3dd8d-bf88-4fa3-b3ca-31535a35542d admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.050876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01798a0-95f7-4b96-9145-ce6aa507b776 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.054810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.055587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.055945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.056282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.056924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.057154 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.058243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.058243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.058469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.059188 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:53.059350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.064608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:53.086564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1332/2637] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:53.087701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:53.099605 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d03d-58f0-4683-88e8-686be83331a4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.104732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.105748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.106094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.106632 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] PATH_INFO: `/v3/projects/73bf605cdb21473d87a7d7d32c29fd35/users/9e36da7c77984469a2668c0c8c2460ff/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.110594 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bf605cdb21473d87a7d7d32c29fd35, user_id=9e36da7c77984469a2668c0c8c2460ff, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.113431 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:53.124817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1333/2638] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:53 2022] PUT /identity/v3/projects/73bf605cdb21473d87a7d7d32c29fd35/users/9e36da7c77984469a2668c0c8c2460ff/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:53.164518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:53.174422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1306/2639] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:52 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:53.175789 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:53.241989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5800ed-6b4a-4c28-a7ad-202ad395b039 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.246877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.247785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.247897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.248170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.249036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.251308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:53.257127 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:53.265936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1334/2640] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:53.267192 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:53.303765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd48f76-43e7-42d4-a58e-429614cb9beb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.310422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05aded-a9f5-44d9-93b8-25bec0a05ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.311574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05aded-a9f5-44d9-93b8-25bec0a05ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.312066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05aded-a9f5-44d9-93b8-25bec0a05ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.312500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05aded-a9f5-44d9-93b8-25bec0a05ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.313545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05aded-a9f5-44d9-93b8-25bec0a05ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.317678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05aded-a9f5-44d9-93b8-25bec0a05ae3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:53.333924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1307/2641] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:53.338046 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:53.354260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab120241-da5e-412b-844b-e003a82f7c84 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.359301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.360191 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.360481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.360914 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] PATH_INFO: `/v3/projects/b36a1c4bbc8e452d9e6a0e9cc3462ba0/users/ecfe7f3954e744928f072831e771ba2c/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.382733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36a1c4bbc8e452d9e6a0e9cc3462ba0, user_id=ecfe7f3954e744928f072831e771ba2c, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.385639 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:53.521070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1335/2642] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:53 2022] PUT /identity/v3/projects/b36a1c4bbc8e452d9e6a0e9cc3462ba0/users/ecfe7f3954e744928f072831e771ba2c/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:53.532779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e443e-c7e5-4247-992c-3be6e174ebda None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.533078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e443e-c7e5-4247-992c-3be6e174ebda None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.533362 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e443e-c7e5-4247-992c-3be6e174ebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.563074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b36e443e-c7e5-4247-992c-3be6e174ebda None None] MFA Rules not processed for user `ecfe7f3954e744928f072831e771ba2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:53.564279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b36e443e-c7e5-4247-992c-3be6e174ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:53.631499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1308/2643] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:53.636558 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:53.718326 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71e9bb-3765-44e0-b701-2548eaafc4d3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.724306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.724986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.725276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.725562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.726418 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.728364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:53.829000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1336/2644] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:53 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:53.829616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e443e-c7e5-4247-992c-3be6e174ebda None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:53.843131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e443e-c7e5-4247-992c-3be6e174ebda None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:53.908900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:53.909538 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:53.909847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:53.910113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:53.911016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:53.916746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:54.036006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:54.044489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1309/2645] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:53 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:54.051661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb28f-bb40-4ae3-a870-6294450e42f3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:54.057841 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:54.059896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.060807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.061282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:54.062616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:54.065664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:54.086130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:54.098156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1337/2646] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:54.100690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78a51-8c92-4abd-bd12-3e807feedc8d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:54.105881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c1911-e6d8-4311-8f84-c09fa0fe5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:54.106629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1911-e6d8-4311-8f84-c09fa0fe5842 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.107053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1911-e6d8-4311-8f84-c09fa0fe5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.107342 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1911-e6d8-4311-8f84-c09fa0fe5842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:54.113242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c1911-e6d8-4311-8f84-c09fa0fe5842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:54.113242 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c1911-e6d8-4311-8f84-c09fa0fe5842 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:54.126711 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1310/2647] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:54.127219 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:54.138905 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc15219-bd4e-475d-bcca-3e7666b2399c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:54.146057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:54.146276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.146507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.146792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] PATH_INFO: `/v3/projects/bf6592b55a194b9f82c281cf6e23185d/users/c01a634f32fc4df399447574f5c0679b/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:54.170556 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6592b55a194b9f82c281cf6e23185d, user_id=c01a634f32fc4df399447574f5c0679b, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:54.172868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:54.275456 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1338/2648] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:54 2022] PUT /identity/v3/projects/bf6592b55a194b9f82c281cf6e23185d/users/c01a634f32fc4df399447574f5c0679b/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:50:54.287495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fda91-4983-49a9-b829-391dc5622ac1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.289024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fda91-4983-49a9-b829-391dc5622ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.289530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fda91-4983-49a9-b829-391dc5622ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:54.322461 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6c8fda91-4983-49a9-b829-391dc5622ac1 None None] MFA Rules not processed for user `c01a634f32fc4df399447574f5c0679b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:54.323968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6c8fda91-4983-49a9-b829-391dc5622ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:54.402194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:54.430990 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1311/2649] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:54.432203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:54.547902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5c5f-e0c3-4b1e-ac72-3ab5a9fec4b0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:54.554528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:54.555212 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.555494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.555928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:54.556611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:54.558665 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:54.657717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1339/2650] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:50:54 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:50:54.658958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fda91-4983-49a9-b829-391dc5622ac1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:54.681623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fda91-4983-49a9-b829-391dc5622ac1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:54.783763 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:54.790750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.790750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.790750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:54.790750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:54.790750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:54.868641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1312/2651] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:50:54 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:50:54.873498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:54.891787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b8df-22a2-42c8-8cea-5d3c657dd8ca admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:54.898667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:54.899630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.900077 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.900515 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:54.901570 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:54.903384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:54.925699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:54.947332 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1340/2652] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:54.953912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:54.973987 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae272-a87e-4ae6-880d-6e4a43b0f5e4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:54.991693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:54.992932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:54.993386 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:54.994056 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] PATH_INFO: `/v3/projects/da6af03bd03e413e8d58e18114bce82b/users/af82cd26203142279ac32465d0bebd4a/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:55.048495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6af03bd03e413e8d58e18114bce82b, user_id=af82cd26203142279ac32465d0bebd4a, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:55.051653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:55.131924 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1313/2653] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:54 2022] PUT /identity/v3/projects/da6af03bd03e413e8d58e18114bce82b/users/af82cd26203142279ac32465d0bebd4a/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:55.135856 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:55.149749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee0fe-4146-4bb6-8ddb-5146910f30ba admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:55.263726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec9c3-b521-4700-adc9-88c357ea29a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:55.264796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec9c3-b521-4700-adc9-88c357ea29a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:55.265857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec9c3-b521-4700-adc9-88c357ea29a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:55.266401 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec9c3-b521-4700-adc9-88c357ea29a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:55.267546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aec9c3-b521-4700-adc9-88c357ea29a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:55.271170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aec9c3-b521-4700-adc9-88c357ea29a3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:55.290043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1341/2654] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:50:55.294747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:55.310927 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851e51-11d3-483e-aeef-d63d18300c10 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:55.321324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:55.323637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:55.323637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:55.323637 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] PATH_INFO: `/v3/projects/da6af03bd03e413e8d58e18114bce82b/users/af82cd26203142279ac32465d0bebd4a/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:55.329023 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6af03bd03e413e8d58e18114bce82b, user_id=af82cd26203142279ac32465d0bebd4a, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:55.332203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:55.345321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1314/2655] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:50:55 2022] PUT /identity/v3/projects/da6af03bd03e413e8d58e18114bce82b/users/af82cd26203142279ac32465d0bebd4a/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:50:55.362964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b2c2-166a-4698-8962-6d1740307615 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:55.363699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b2c2-166a-4698-8962-6d1740307615 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:55.364170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b2c2-166a-4698-8962-6d1740307615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:55.399339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-6ab0b2c2-166a-4698-8962-6d1740307615 None None] MFA Rules not processed for user `af82cd26203142279ac32465d0bebd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:55.403982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-6ab0b2c2-166a-4698-8962-6d1740307615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:55.493803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1342/2656] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:55.507676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:55.509480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:55.587186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7fd33-5c50-42f3-9b2c-66947928a450 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:55.593379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:55.594364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:55.594908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:55.595261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:55.663853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:55.675440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:55.676925 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:55.716212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1315/2657] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:57.791526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b2c2-166a-4698-8962-6d1740307615 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:57.802700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b2c2-166a-4698-8962-6d1740307615 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:57.806674 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f5aa-76b7-44d8-8b29-e2da2165dea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:57.807475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f5aa-76b7-44d8-8b29-e2da2165dea2 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:57.807896 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f5aa-76b7-44d8-8b29-e2da2165dea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:57.808280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f5aa-76b7-44d8-8b29-e2da2165dea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:57.877818 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5f5aa-76b7-44d8-8b29-e2da2165dea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:57.879327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5f5aa-76b7-44d8-8b29-e2da2165dea2 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:57.889577 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1343/2658] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:58.148226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:58.150370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:58.233181 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477f1e-4d73-4839-9868-35fa52565ad9 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:58.237017 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:58.237605 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:58.238238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:58.238688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:58.240830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:58.346357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:58.347845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:58.361841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1316/2659] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:59.328705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d98fe-7311-454a-b1b7-1950a84ac140 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:59.329565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d98fe-7311-454a-b1b7-1950a84ac140 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:59.329848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d98fe-7311-454a-b1b7-1950a84ac140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:59.363195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-424d98fe-7311-454a-b1b7-1950a84ac140 None None] MFA Rules not processed for user `9e36da7c77984469a2668c0c8c2460ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:50:59.369006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-424d98fe-7311-454a-b1b7-1950a84ac140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:59.383804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:59.456831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1344/2660] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:50:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:50:59.471406 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:59.473776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:59.563213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a65062-9b35-4444-8bbd-bb5a224c3d70 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:59.569391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:59.570048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:59.570367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:59.570648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:59.572407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:50:59.629752 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:59.656364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:59.658125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:59.668929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1317/2661] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:50:59.760800 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d98fe-7311-454a-b1b7-1950a84ac140 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:50:59.776364 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d98fe-7311-454a-b1b7-1950a84ac140 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:50:59.781099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:50:59.781930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:50:59.782429 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:50:59.782706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:50:59.793085 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:50:59.795196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:50:59.826462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1345/2662] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:50:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:02.689558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:02.691324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:02.797721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214fba-9de4-4ecd-92eb-f54f0d7d7943 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:02.804384 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d42f9-2a09-4cd6-bd2e-f7d22b2ccab7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:02.805320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d42f9-2a09-4cd6-bd2e-f7d22b2ccab7 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:02.805807 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d42f9-2a09-4cd6-bd2e-f7d22b2ccab7 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:02.806293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d42f9-2a09-4cd6-bd2e-f7d22b2ccab7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:02.808548 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-801d42f9-2a09-4cd6-bd2e-f7d22b2ccab7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:02.821445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d42f9-2a09-4cd6-bd2e-f7d22b2ccab7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:02.823370 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d42f9-2a09-4cd6-bd2e-f7d22b2ccab7 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:02.834512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1318/2663] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:02.869424 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:02.873195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:02.926992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2816-ee93-44eb-af08-0529a337bd93 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:02.932149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:02.933087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:02.933308 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:02.933586 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] PATH_INFO: `/v3/users/5205045922ca4dab8d556845be5f574b` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:02.935314 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5205045922ca4dab8d556845be5f574b)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:02.937333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:02.954695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74964638-11b9-4ff7-a144-7e7b2f739e21 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:02.954695 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74964638-11b9-4ff7-a144-7e7b2f739e21 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:02.955019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74964638-11b9-4ff7-a144-7e7b2f739e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:02.982076 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-74964638-11b9-4ff7-a144-7e7b2f739e21 None None] MFA Rules not processed for user `a74caf83bb2642059665cde2cf6112b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:02.983677 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-74964638-11b9-4ff7-a144-7e7b2f739e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:03.010503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1319/2664] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:03.245704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5205045922ca4dab8d556845be5f574b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:03.257069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5205045922ca4dab8d556845be5f574b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:03.258779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5205045922ca4dab8d556845be5f574b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:03.259412 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5205045922ca4dab8d556845be5f574b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:03.364522 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09e5982b-07b6-4d2d-8a5c-ae10b9adef25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5205045922ca4dab8d556845be5f574b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:03.384015 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1346/2665] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:51:02 2022] DELETE /identity/v3/users/5205045922ca4dab8d556845be5f574b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:03.680528 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74964638-11b9-4ff7-a144-7e7b2f739e21 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:03.708305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74964638-11b9-4ff7-a144-7e7b2f739e21 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:03.767879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:03.768742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:03.769029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:03.769330 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] PATH_INFO: `/v3/projects/1d4839e190b84180bbe09a9bbbd06c1d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:03.770619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4839e190b84180bbe09a9bbbd06c1d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:03.772573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:03.941881 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4839e190b84180bbe09a9bbbd06c1d', 'request_id': 'req-aab63bc9-0417-4910-85e5-979feebb7118'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:03.950772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4839e190b84180bbe09a9bbbd06c1d', 'request_id': 'req-aab63bc9-0417-4910-85e5-979feebb7118'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:03.955621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:04.044680 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4839e190b84180bbe09a9bbbd06c1d', 'request_id': 'req-aab63bc9-0417-4910-85e5-979feebb7118'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:04.058435 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] The token cache is being invalidate because project 1d4839e190b84180bbe09a9bbbd06c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:51:04.058724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:04.059367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-aab63bc9-0417-4910-85e5-979feebb7118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:04.061015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1320/2666] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:51:03 2022] DELETE /identity/v3/projects/1d4839e190b84180bbe09a9bbbd06c1d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:04.066384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c306ea-e139-49db-a4f1-b7131c89832a None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.066861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c306ea-e139-49db-a4f1-b7131c89832a None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.066982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c306ea-e139-49db-a4f1-b7131c89832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.088684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-73c306ea-e139-49db-a4f1-b7131c89832a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:04.090452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-73c306ea-e139-49db-a4f1-b7131c89832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:04.156494 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1347/2667] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:51:04.164902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d19ed-c287-41b7-8db4-806cb40862e7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.165202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d19ed-c287-41b7-8db4-806cb40862e7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.165485 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d19ed-c287-41b7-8db4-806cb40862e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.190832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0c6d19ed-c287-41b7-8db4-806cb40862e7 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:04.192322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0c6d19ed-c287-41b7-8db4-806cb40862e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:04.201759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1321/2668] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:04.206099 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c306ea-e139-49db-a4f1-b7131c89832a None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.212327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:04.216167 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c306ea-e139-49db-a4f1-b7131c89832a None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:04.220820 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:04.221476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.221768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.222050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.222810 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:04.223122 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:04.224731 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:04.236924 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1348/2669] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:04.241385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d19ed-c287-41b7-8db4-806cb40862e7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.251055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d19ed-c287-41b7-8db4-806cb40862e7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:04.255780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:04.256420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.256701 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.256985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.257648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:04.259600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:04.357459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1322/2670] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:51:04 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:04.361591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.375369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddabf1-f59e-41bd-8019-bac5ff6d774f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:04.442248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:04.443538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.446603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.446603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.446603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:04.447161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:04.556322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1349/2671] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:51:04 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:04.558659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.572834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0472d3f-8d60-45f2-9e95-227e887f280b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:04.577616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:04.578266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.578574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.578847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.579607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:04.584389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:04.598580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1323/2672] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:04.602468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.613253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b25db-88b6-421f-bfed-871965af77e4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:04.618120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb116df-7b38-4f91-8e2e-ade4b6f43084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:04.618877 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb116df-7b38-4f91-8e2e-ade4b6f43084 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.619166 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb116df-7b38-4f91-8e2e-ade4b6f43084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.619467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb116df-7b38-4f91-8e2e-ade4b6f43084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.620198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb116df-7b38-4f91-8e2e-ade4b6f43084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:04.621806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb116df-7b38-4f91-8e2e-ade4b6f43084 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:04.633588 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1350/2673] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:04.637831 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.648019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ab455-a497-4ed6-952e-871ecf689389 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:04.652756 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:04.653750 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.654103 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.654479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] PATH_INFO: `/v3/projects/e767a71e041048a096cd9ebe3090b8b5/users/c9e2963a1b3b424a96f85c7b1e77934b/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.673119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e767a71e041048a096cd9ebe3090b8b5, user_id=c9e2963a1b3b424a96f85c7b1e77934b, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:04.676025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:04.778060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1324/2674] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:51:04 2022] PUT /identity/v3/projects/e767a71e041048a096cd9ebe3090b8b5/users/c9e2963a1b3b424a96f85c7b1e77934b/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:51:04.783492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:04.783788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:04.784075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:04.808666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:04.810651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:04.909824 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1351/2675] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:04.922876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.925089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:04.985369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:04.987335 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:05.000817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f657a-e2cc-42c1-ba20-55718e861346 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:05.014072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:05.014996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:05.015280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:05.015553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] PATH_INFO: `/v3/users/ecfe7f3954e744928f072831e771ba2c` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:05.017718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfe7f3954e744928f072831e771ba2c)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:05.024899 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:05.092863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630fcd-b24e-401a-a8ac-4a683fec9d4e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:05.097789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d55275-379c-42d2-bc28-ec45e75da7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:05.097789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55275-379c-42d2-bc28-ec45e75da7be service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:05.097789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55275-379c-42d2-bc28-ec45e75da7be service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:05.098267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55275-379c-42d2-bc28-ec45e75da7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:05.108690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d55275-379c-42d2-bc28-ec45e75da7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:05.110089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d55275-379c-42d2-bc28-ec45e75da7be service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:05.121143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1325/2676] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:05.293272 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfe7f3954e744928f072831e771ba2c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:05.302248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfe7f3954e744928f072831e771ba2c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:05.303190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfe7f3954e744928f072831e771ba2c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:05.305035 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfe7f3954e744928f072831e771ba2c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:05.388368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfe7f3954e744928f072831e771ba2c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:05.392000 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:05.408622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1352/2677] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:51:04 2022] DELETE /identity/v3/users/ecfe7f3954e744928f072831e771ba2c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:51:05.413114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:05.413409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:05.413688 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:05.431144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:05.432336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:05.513655 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1326/2678] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:05.520975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:05.522526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:05.594679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1fbeb-9aa2-478b-a2b3-c00b081a47cd admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:05.598373 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:05.598980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:05.599267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:05.599543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:05.609534 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:05.611011 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:05.620591 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1353/2679] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:06.011429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:06.013045 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:06.025789 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa6fc-2e19-449e-94de-72a2b7f1d0ed None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:06.031257 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:06.036577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:06.036577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:06.036577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] PATH_INFO: `/v3/projects/b36a1c4bbc8e452d9e6a0e9cc3462ba0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:06.036577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36a1c4bbc8e452d9e6a0e9cc3462ba0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:06.036577 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:06.172487 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:06.191421 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36a1c4bbc8e452d9e6a0e9cc3462ba0', 'request_id': 'req-3f9bff9d-81e9-4271-941d-9f7bd195cf85'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.196814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36a1c4bbc8e452d9e6a0e9cc3462ba0', 'request_id': 'req-3f9bff9d-81e9-4271-941d-9f7bd195cf85'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.296206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36a1c4bbc8e452d9e6a0e9cc3462ba0', 'request_id': 'req-3f9bff9d-81e9-4271-941d-9f7bd195cf85'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.308081 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] The token cache is being invalidate because project b36a1c4bbc8e452d9e6a0e9cc3462ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:51:06.308371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.308996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.311228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1327/2680] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:51:06 2022] DELETE /identity/v3/projects/b36a1c4bbc8e452d9e6a0e9cc3462ba0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:06.315301 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:06.324880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2d0f-2dbf-45c1-892a-42d8621f7a8a service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:06.385428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:06.386414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:06.386696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:06.386976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] PATH_INFO: `/v3/users/c01a634f32fc4df399447574f5c0679b` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:06.388150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01a634f32fc4df399447574f5c0679b)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:06.390100 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:06.847426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01a634f32fc4df399447574f5c0679b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.856293 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01a634f32fc4df399447574f5c0679b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.857090 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01a634f32fc4df399447574f5c0679b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.857836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01a634f32fc4df399447574f5c0679b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.925104 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01a634f32fc4df399447574f5c0679b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:06.966831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1354/2681] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:51:06 2022] DELETE /identity/v3/users/c01a634f32fc4df399447574f5c0679b => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:51:07.515534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:07.517748 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:07.550039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bff9d-81e9-4271-941d-9f7bd195cf85 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:07.612367 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:07.613269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:07.613541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:07.613814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] PATH_INFO: `/v3/projects/bf6592b55a194b9f82c281cf6e23185d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:07.615156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6592b55a194b9f82c281cf6e23185d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:07.617535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:07.764793 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6592b55a194b9f82c281cf6e23185d', 'request_id': 'req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:07.770840 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6592b55a194b9f82c281cf6e23185d', 'request_id': 'req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:07.884010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6592b55a194b9f82c281cf6e23185d', 'request_id': 'req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:07.896914 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] The token cache is being invalidate because project bf6592b55a194b9f82c281cf6e23185d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:51:07.899782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:07.899782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:07.899782 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1328/2682] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:51:07 2022] DELETE /identity/v3/projects/bf6592b55a194b9f82c281cf6e23185d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:51:07.903755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:07.909202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:07.924319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:07.929205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dc826-cd94-4e8c-a1be-24bad9191760 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:07.994143 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:07.995089 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:07.995447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:07.995795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] PATH_INFO: `/v3/users/af82cd26203142279ac32465d0bebd4a` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:07.997080 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af82cd26203142279ac32465d0bebd4a)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:07.999730 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:08.235037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af82cd26203142279ac32465d0bebd4a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:08.243913 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af82cd26203142279ac32465d0bebd4a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:08.244871 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af82cd26203142279ac32465d0bebd4a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:08.245567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af82cd26203142279ac32465d0bebd4a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:08.335492 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-768efaf5-27e5-44f3-8328-5ba374273d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af82cd26203142279ac32465d0bebd4a'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:08.363171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1355/2683] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:51:07 2022] DELETE /identity/v3/users/af82cd26203142279ac32465d0bebd4a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:08.911011 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:08.912504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:08.936606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ccc4-ba26-4f2e-84c3-5399df743c8a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:09.039566 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:09.072229 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:09.073407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:09.073860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:09.074356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] PATH_INFO: `/v3/projects/da6af03bd03e413e8d58e18114bce82b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:09.077846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6af03bd03e413e8d58e18114bce82b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:09.083610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:09.260973 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6af03bd03e413e8d58e18114bce82b', 'request_id': 'req-4b18b628-659a-46fc-bd4d-d12a776a89df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:09.269155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6af03bd03e413e8d58e18114bce82b', 'request_id': 'req-4b18b628-659a-46fc-bd4d-d12a776a89df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:09.530775 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6af03bd03e413e8d58e18114bce82b', 'request_id': 'req-4b18b628-659a-46fc-bd4d-d12a776a89df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:09.543758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] The token cache is being invalidate because project da6af03bd03e413e8d58e18114bce82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:51:09.555671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:09.558498 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4b18b628-659a-46fc-bd4d-d12a776a89df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:09.562898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1329/2684] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:51:08 2022] DELETE /identity/v3/projects/da6af03bd03e413e8d58e18114bce82b => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:09.567990 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6662-d13e-4386-ba6c-5732274590c8 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:09.568986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6662-d13e-4386-ba6c-5732274590c8 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:09.569480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6662-d13e-4386-ba6c-5732274590c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:09.595140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-18bb6662-d13e-4386-ba6c-5732274590c8 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:09.596748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-18bb6662-d13e-4386-ba6c-5732274590c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:09.683096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1356/2685] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:09.692034 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca658-c5a7-48b8-97d5-8ee370cbe4ba None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:09.692350 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca658-c5a7-48b8-97d5-8ee370cbe4ba None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:09.692642 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca658-c5a7-48b8-97d5-8ee370cbe4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:09.713318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-344ca658-c5a7-48b8-97d5-8ee370cbe4ba None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:09.714726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-344ca658-c5a7-48b8-97d5-8ee370cbe4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:09.725443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1330/2686] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:09.730684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6662-d13e-4386-ba6c-5732274590c8 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:09.740960 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6662-d13e-4386-ba6c-5732274590c8 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:09.745607 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:09.746286 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:09.746572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:09.746851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:09.747575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:09.747887 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:09.750094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:09.765539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1357/2687] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:09.766749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca658-c5a7-48b8-97d5-8ee370cbe4ba None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:09.779568 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca658-c5a7-48b8-97d5-8ee370cbe4ba None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:09.796917 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:09.797606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:09.797895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:09.798173 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:09.798910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:09.801463 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:09.903171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1331/2688] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:51:09 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:09.907743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:09.918353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f713178-7287-41e0-bba1-0e55ce23959f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:09.927888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:09.981981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:09.982702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:09.983848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:09.983848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:09.984510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:09.986489 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:10.091073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1358/2689] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:51:09 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:10.095678 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:10.107269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60bad-c7d0-4a41-a5f9-17b8a8917731 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:10.114195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:10.115347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:10.115845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:10.116314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:10.117452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:10.119573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:10.134169 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1332/2690] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:10.140706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:10.152763 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d14e1-930f-4330-92c2-b5b60251153e admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:10.162141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8fddd-8e9f-4e4f-a0e0-81bf5be2707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:10.163716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fddd-8e9f-4e4f-a0e0-81bf5be2707b admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:10.164199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fddd-8e9f-4e4f-a0e0-81bf5be2707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:10.164526 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8fddd-8e9f-4e4f-a0e0-81bf5be2707b admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:10.165481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8fddd-8e9f-4e4f-a0e0-81bf5be2707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:10.167680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8fddd-8e9f-4e4f-a0e0-81bf5be2707b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:10.187142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1359/2691] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:10.189402 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:10.215080 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9f9c9-e19c-4e3f-ae83-49a41783f971 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:10.220800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:10.225297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:10.225297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:10.225297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] PATH_INFO: `/v3/projects/913429fa7ed34238962c8bfecd4b6724/users/c373e138c350449dac25954e13da6a39/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:10.240529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] RBAC: Authorizing `identity:create_grant(project_id=913429fa7ed34238962c8bfecd4b6724, user_id=c373e138c350449dac25954e13da6a39, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:10.243535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:10.320148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1333/2692] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:51:10 2022] PUT /identity/v3/projects/913429fa7ed34238962c8bfecd4b6724/users/c373e138c350449dac25954e13da6a39/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:10.332300 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e4eb-46d1-46c3-909b-50a6233cf7af None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:10.332852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e4eb-46d1-46c3-909b-50a6233cf7af None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:10.333322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e4eb-46d1-46c3-909b-50a6233cf7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:10.372354 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8410e4eb-46d1-46c3-909b-50a6233cf7af None None] MFA Rules not processed for user `c373e138c350449dac25954e13da6a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:10.373703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8410e4eb-46d1-46c3-909b-50a6233cf7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:10.471655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1360/2693] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:10.484785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:10.486636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:10.572000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6ef83-6c44-4a0a-80d1-2b8b4c8e683c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:10.577266 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:10.577714 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:10.578000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:10.578365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:10.588232 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:10.589784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:10.603151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1334/2694] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:11.585790 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad2b0-259e-41ae-9828-5cd26e8e3934 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:11.591544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad2b0-259e-41ae-9828-5cd26e8e3934 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:11.591544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad2b0-259e-41ae-9828-5cd26e8e3934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:11.614133 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-538ad2b0-259e-41ae-9828-5cd26e8e3934 None None] MFA Rules not processed for user `c9e2963a1b3b424a96f85c7b1e77934b`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:11.615378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-538ad2b0-259e-41ae-9828-5cd26e8e3934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:11.696493 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1361/2695] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:11.712021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:11.713829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:11.729649 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:11.802611 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85bdda-07c1-4515-8ec1-b054f4f261c4 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:11.808628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7af570-7049-488e-93a6-efcb3d6d141c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:11.811865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af570-7049-488e-93a6-efcb3d6d141c service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:11.811865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af570-7049-488e-93a6-efcb3d6d141c service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:11.811865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af570-7049-488e-93a6-efcb3d6d141c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:11.818483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7af570-7049-488e-93a6-efcb3d6d141c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:11.820067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7af570-7049-488e-93a6-efcb3d6d141c service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:11.828728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1335/2696] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:51:13.953490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad2b0-259e-41ae-9828-5cd26e8e3934 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:13.965396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:14.023194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad2b0-259e-41ae-9828-5cd26e8e3934 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:14.028291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:14.030965 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:14.031339 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:14.031518 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] PATH_INFO: `/v3/users/c373e138c350449dac25954e13da6a39` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:14.032772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c373e138c350449dac25954e13da6a39)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:14.034735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:14.214528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c373e138c350449dac25954e13da6a39'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:14.222448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c373e138c350449dac25954e13da6a39'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:14.223170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c373e138c350449dac25954e13da6a39'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:14.223769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c373e138c350449dac25954e13da6a39'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:14.264799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438973-7d4a-494a-863a-608c1d4ed83a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:14.265314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438973-7d4a-494a-863a-608c1d4ed83a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:14.265314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438973-7d4a-494a-863a-608c1d4ed83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:14.285059 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a7438973-7d4a-494a-863a-608c1d4ed83a None None] MFA Rules not processed for user `c9e2963a1b3b424a96f85c7b1e77934b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:14.286329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a7438973-7d4a-494a-863a-608c1d4ed83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:14.293427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1336/2697] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:14.330517 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c373e138c350449dac25954e13da6a39'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:14.355256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1362/2698] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:51:13 2022] DELETE /identity/v3/users/c373e138c350449dac25954e13da6a39 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:14.359928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:14.360475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:14.360758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:14.379796 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:14.381113 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:14.457676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1337/2699] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:14.469426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:14.470879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:14.541371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d144-0c33-4b45-bd18-23268ffbe745 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:14.545275 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a3471-5898-44c5-9a99-5ad9dd96d01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:14.547702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3471-5898-44c5-9a99-5ad9dd96d01f service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:14.547702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3471-5898-44c5-9a99-5ad9dd96d01f service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:14.547702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3471-5898-44c5-9a99-5ad9dd96d01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:14.557576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a3471-5898-44c5-9a99-5ad9dd96d01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:14.559149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a3471-5898-44c5-9a99-5ad9dd96d01f service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:14.574551 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1363/2700] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:15.091636 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.093234 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:15.106025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2bee6-e1d8-48ac-a68d-406bcc3b88e2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.118813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.123286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.123286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.123286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] PATH_INFO: `/v3/projects/913429fa7ed34238962c8bfecd4b6724` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.123286 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913429fa7ed34238962c8bfecd4b6724)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.125765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.240854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913429fa7ed34238962c8bfecd4b6724', 'request_id': 'req-53a70ba9-4f00-46fb-9a1a-359b8578c514'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:15.249523 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913429fa7ed34238962c8bfecd4b6724', 'request_id': 'req-53a70ba9-4f00-46fb-9a1a-359b8578c514'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:15.313607 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913429fa7ed34238962c8bfecd4b6724', 'request_id': 'req-53a70ba9-4f00-46fb-9a1a-359b8578c514'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:15.326148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] The token cache is being invalidate because project 913429fa7ed34238962c8bfecd4b6724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:51:15.326669 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:15.327233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-53a70ba9-4f00-46fb-9a1a-359b8578c514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:15.332000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1338/2701] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:51:15 2022] DELETE /identity/v3/projects/913429fa7ed34238962c8bfecd4b6724 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:15.333873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f44de-0bad-486e-88ef-18cdb1d49d6c None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.334315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f44de-0bad-486e-88ef-18cdb1d49d6c None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.334468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f44de-0bad-486e-88ef-18cdb1d49d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.352999 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-de4f44de-0bad-486e-88ef-18cdb1d49d6c None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:15.354194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-de4f44de-0bad-486e-88ef-18cdb1d49d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:15.384198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:15.417251 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1364/2702] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:15.425812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f437-6606-40ea-a5f2-66435a5452b2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.426107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f437-6606-40ea-a5f2-66435a5452b2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.426422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f437-6606-40ea-a5f2-66435a5452b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.444492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a8f6f437-6606-40ea-a5f2-66435a5452b2 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:15.445687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a8f6f437-6606-40ea-a5f2-66435a5452b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:15.453618 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1339/2703] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:15.457822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f44de-0bad-486e-88ef-18cdb1d49d6c None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.468423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f44de-0bad-486e-88ef-18cdb1d49d6c None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.472986 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.473641 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.473927 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.474205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.474953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:15.475266 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.476952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.490433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1365/2704] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:15.494093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f437-6606-40ea-a5f2-66435a5452b2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.503379 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f437-6606-40ea-a5f2-66435a5452b2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.507958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.508599 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.508923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.509197 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.509879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.511860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.516145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:15.617835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1340/2705] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:51:15 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:15.621942 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.631976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc5d2a-597f-4619-989f-9ef9774b8164 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.700672 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.701846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.702168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.702457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.703149 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.705074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.799603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1366/2706] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:51:15 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:15.803641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.813806 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4bc12-d867-4318-a73d-917f5b92c576 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.818494 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.819148 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.819449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.819720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.820438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.822033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.837721 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1341/2707] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:15.840578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.851128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2fe64-3db5-4b93-b355-4dae2e5d02bc admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.855718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e1290-2723-4213-9ba9-553932b356d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.856370 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1290-2723-4213-9ba9-553932b356d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.856660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1290-2723-4213-9ba9-553932b356d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.856936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1290-2723-4213-9ba9-553932b356d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.857651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e1290-2723-4213-9ba9-553932b356d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.859292 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e1290-2723-4213-9ba9-553932b356d3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.869056 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1367/2708] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:15.875094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.884952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15468f73-190f-46de-9f9e-a6bdb0b4098c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.890666 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.891535 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.891821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.892099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] PATH_INFO: `/v3/projects/cf140546af5b444ab206981ae9263f94/users/422de730a1f9444ba20220cf51b349fe/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.906993 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf140546af5b444ab206981ae9263f94, user_id=422de730a1f9444ba20220cf51b349fe, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.909640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:16.000265 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1342/2709] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:51:15 2022] PUT /identity/v3/projects/cf140546af5b444ab206981ae9263f94/users/422de730a1f9444ba20220cf51b349fe/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:16.011263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bef091-515e-447e-a78f-de3162e0a764 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:16.011559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bef091-515e-447e-a78f-de3162e0a764 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:16.011839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bef091-515e-447e-a78f-de3162e0a764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:16.038022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c9bef091-515e-447e-a78f-de3162e0a764 None None] MFA Rules not processed for user `422de730a1f9444ba20220cf51b349fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:16.039241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c9bef091-515e-447e-a78f-de3162e0a764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:16.103130 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1368/2710] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:16.114787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:16.116497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:16.175835 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd68a0e-ec11-417f-914f-9028e1633439 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:16.179443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebd308-7aec-448e-9a63-6f547aef6d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:16.180086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd308-7aec-448e-9a63-6f547aef6d39 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:16.180372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd308-7aec-448e-9a63-6f547aef6d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:16.180651 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd308-7aec-448e-9a63-6f547aef6d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:16.189310 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebd308-7aec-448e-9a63-6f547aef6d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:16.190791 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebd308-7aec-448e-9a63-6f547aef6d39 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:16.199957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1343/2711] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:16.224898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bef091-515e-447e-a78f-de3162e0a764 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:16.256178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:16.293996 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bef091-515e-447e-a78f-de3162e0a764 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:16.300221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:16.301199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:16.301617 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:16.301904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] PATH_INFO: `/v3/users/422de730a1f9444ba20220cf51b349fe` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:16.303361 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422de730a1f9444ba20220cf51b349fe)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:16.305289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:16.618537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422de730a1f9444ba20220cf51b349fe'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:16.625772 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422de730a1f9444ba20220cf51b349fe'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:16.626427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422de730a1f9444ba20220cf51b349fe'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:16.627049 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422de730a1f9444ba20220cf51b349fe'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:16.747356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422de730a1f9444ba20220cf51b349fe'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:16.767808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1369/2712] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:51:16 2022] DELETE /identity/v3/users/422de730a1f9444ba20220cf51b349fe => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:16.771944 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfcb62-e306-4074-9254-e9a8a10a7c2a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:16.772988 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfcb62-e306-4074-9254-e9a8a10a7c2a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:16.773334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfcb62-e306-4074-9254-e9a8a10a7c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:16.806920 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cecfcb62-e306-4074-9254-e9a8a10a7c2a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:16.808158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cecfcb62-e306-4074-9254-e9a8a10a7c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:16.880582 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1344/2713] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:51:16.891296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:16.892629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:16.959546 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048f6d-94a3-4d28-a961-7266799020b0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:16.966485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:16.967180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:16.967471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:16.967809 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:16.978451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:16.982447 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:16.990802 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1370/2714] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:17.199616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfcb62-e306-4074-9254-e9a8a10a7c2a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:17.209331 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfcb62-e306-4074-9254-e9a8a10a7c2a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:17.212893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991bd8b-0f6a-4765-84b0-079c5b5d9616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:17.213648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bd8b-0f6a-4765-84b0-079c5b5d9616 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:17.213938 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bd8b-0f6a-4765-84b0-079c5b5d9616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:17.214290 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bd8b-0f6a-4765-84b0-079c5b5d9616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:17.216060 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e991bd8b-0f6a-4765-84b0-079c5b5d9616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:17.225596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991bd8b-0f6a-4765-84b0-079c5b5d9616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:17.227042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991bd8b-0f6a-4765-84b0-079c5b5d9616 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:17.235873 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1345/2715] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:17.703825 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:17.705346 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:17.719476 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143a17d-69ce-4524-bd65-07ea0b83f98a service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:17.729356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:17.729356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:17.729356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:17.729356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] PATH_INFO: `/v3/projects/cf140546af5b444ab206981ae9263f94` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:17.729822 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf140546af5b444ab206981ae9263f94)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:17.732267 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:17.854664 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:17.858615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf140546af5b444ab206981ae9263f94', 'request_id': 'req-788f1857-089d-44df-8407-f9f411951b3c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:17.864052 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf140546af5b444ab206981ae9263f94', 'request_id': 'req-788f1857-089d-44df-8407-f9f411951b3c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:17.978180 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf140546af5b444ab206981ae9263f94', 'request_id': 'req-788f1857-089d-44df-8407-f9f411951b3c'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:17.992269 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] The token cache is being invalidate because project cf140546af5b444ab206981ae9263f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:51:17.992563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:17.993226 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-788f1857-089d-44df-8407-f9f411951b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:51:17.994834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1371/2716] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:51:17 2022] DELETE /identity/v3/projects/cf140546af5b444ab206981ae9263f94 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:18.000128 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500e05-9269-41b6-8ab4-7422a506f476 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.000600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500e05-9269-41b6-8ab4-7422a506f476 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.000698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500e05-9269-41b6-8ab4-7422a506f476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.019639 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fc500e05-9269-41b6-8ab4-7422a506f476 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:18.020852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fc500e05-9269-41b6-8ab4-7422a506f476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:18.061462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.081660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1346/2717] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:18.147782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d257e-3630-45ea-a3e9-d1ced6ba9946 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.147782 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d257e-3630-45ea-a3e9-d1ced6ba9946 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.148322 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d257e-3630-45ea-a3e9-d1ced6ba9946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.168716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-106d257e-3630-45ea-a3e9-d1ced6ba9946 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:18.170589 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-106d257e-3630-45ea-a3e9-d1ced6ba9946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:18.178863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1372/2718] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:18.183784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500e05-9269-41b6-8ab4-7422a506f476 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.195211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500e05-9269-41b6-8ab4-7422a506f476 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.201906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.202120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.202821 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.203189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.203995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:18.204465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.206108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.230524 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1347/2719] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:18.231012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d257e-3630-45ea-a3e9-d1ced6ba9946 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.244241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d257e-3630-45ea-a3e9-d1ced6ba9946 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.250433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.250955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.251239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.251516 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.252222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.254145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.363444 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1373/2720] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:51:18 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:18.364727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.375557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31d614-2fa9-47ba-b62a-e6e50fda1777 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.468815 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.469516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.469910 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.470205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.471036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.473001 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.601382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1348/2721] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:51:18 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:18.605689 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.619686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a63e6-dfb5-40fa-8a06-9e66e0e00184 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.628471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.629298 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.629733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.630135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.632128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.634392 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.649264 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1374/2722] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:18.653895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.664804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af208-29ab-45f9-ac37-dd0c4543794d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.670842 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4a0b2-f201-4f1c-93cd-82a35f589581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.671558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a0b2-f201-4f1c-93cd-82a35f589581 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.671843 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a0b2-f201-4f1c-93cd-82a35f589581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.672125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a0b2-f201-4f1c-93cd-82a35f589581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.676052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4a0b2-f201-4f1c-93cd-82a35f589581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.676052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4a0b2-f201-4f1c-93cd-82a35f589581 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.687432 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1349/2723] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:51:18.691590 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.701531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a013b3-7dae-40c0-9e72-2dc6d11f1086 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.706274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.707154 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.707435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.707711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] PATH_INFO: `/v3/projects/fd72c8bc35224d4fa54af047f0bf3f49/users/9683f1d0bf204dc1832786db1a4c756f/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.722611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd72c8bc35224d4fa54af047f0bf3f49, user_id=9683f1d0bf204dc1832786db1a4c756f, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.725901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.817240 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1375/2724] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:51:18 2022] PUT /identity/v3/projects/fd72c8bc35224d4fa54af047f0bf3f49/users/9683f1d0bf204dc1832786db1a4c756f/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:18.822557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e293ac-c132-4817-8235-cbadd1e22358 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.822854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e293ac-c132-4817-8235-cbadd1e22358 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.823132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e293ac-c132-4817-8235-cbadd1e22358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.840315 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-61e293ac-c132-4817-8235-cbadd1e22358 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:18.841532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-61e293ac-c132-4817-8235-cbadd1e22358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:18.905394 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1350/2725] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:18.915519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.917471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:18.985805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5ddbc-abd8-48e5-b976-37935cce63c9 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.989595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.990274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.990563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.990845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:19.000353 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:19.001801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:19.011618 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1376/2726] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:25.275418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005c39-f752-4d00-906a-57c2baa9b4f9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.275940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005c39-f752-4d00-906a-57c2baa9b4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.276139 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005c39-f752-4d00-906a-57c2baa9b4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.311355 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-52005c39-f752-4d00-906a-57c2baa9b4f9 None None] MFA Rules not processed for user `9683f1d0bf204dc1832786db1a4c756f`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:25.315495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-52005c39-f752-4d00-906a-57c2baa9b4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:25.374513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:25.424539 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1351/2727] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:25.431310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:25.441710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6a14-f01b-4762-acaf-4fd5342520f3 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:25.446465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:25.447124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.447743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.447743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.448715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:25.450274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:25.537982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1377/2728] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:51:25 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:25.542062 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005c39-f752-4d00-906a-57c2baa9b4f9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:25.553109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005c39-f752-4d00-906a-57c2baa9b4f9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:25.609326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:25.609997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.610314 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.610589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.611269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:25.616389 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:25.702369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1352/2729] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:51:25 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:25.707121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:25.718023 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31ddb-0dd9-4487-87bc-9ec6a993d792 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:25.722699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:25.723355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.723637 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.723910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.724652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:25.726263 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:25.737235 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1378/2730] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:25.741450 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:25.752364 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bacd48-9766-46e7-8bbd-49ad233dac74 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:25.756980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:25.757863 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.758144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.758471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] PATH_INFO: `/v3/projects/9e69bdf8e6404b70923194ebc35bce3a/users/727a5d1960f641f8934c62800c1f522b/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.774456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e69bdf8e6404b70923194ebc35bce3a, user_id=727a5d1960f641f8934c62800c1f522b, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:25.777864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:25.897073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1353/2731] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:51:25 2022] PUT /identity/v3/projects/9e69bdf8e6404b70923194ebc35bce3a/users/727a5d1960f641f8934c62800c1f522b/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:25.907655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:25.912371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8dac3-7acb-4004-87bc-4f7c03f64fa3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:25.947102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:25.969936 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0a9d-0938-433c-868a-4eeff05e37ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:25.970647 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0a9d-0938-433c-868a-4eeff05e37ee admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.970957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0a9d-0938-433c-868a-4eeff05e37ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.971218 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0a9d-0938-433c-868a-4eeff05e37ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.971938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0a9d-0938-433c-868a-4eeff05e37ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:25.973636 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0a9d-0938-433c-868a-4eeff05e37ee admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:25.987290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1379/2732] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:51:25.993659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:26.003361 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905d6b-e507-475e-9bc6-04c048e65f0b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.010564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.011564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.011968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.012267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] PATH_INFO: `/v3/projects/9e69bdf8e6404b70923194ebc35bce3a/users/727a5d1960f641f8934c62800c1f522b/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.014407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e69bdf8e6404b70923194ebc35bce3a, user_id=727a5d1960f641f8934c62800c1f522b, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:26.017079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:26.027902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1354/2733] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:51:25 2022] PUT /identity/v3/projects/9e69bdf8e6404b70923194ebc35bce3a/users/727a5d1960f641f8934c62800c1f522b/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:33.029291 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328122-b891-498a-af90-19fcdbe044fc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.030010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328122-b891-498a-af90-19fcdbe044fc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.030119 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328122-b891-498a-af90-19fcdbe044fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.075315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-3a328122-b891-498a-af90-19fcdbe044fc None None] MFA Rules not processed for user `727a5d1960f641f8934c62800c1f522b`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:33.077071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3a328122-b891-498a-af90-19fcdbe044fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:33.282519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1380/2734] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:33.293784 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.297182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:33.358181 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd7894-7533-4471-b984-61c71f3ecde2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:33.361742 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:33.362452 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.362829 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.363112 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.412543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:33.426275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:33.428770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:33.441222 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1355/2735] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:33.718004 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.718340 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.718623 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.738248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:33.739655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:33.798030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1381/2736] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:51:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:33.940036 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.941438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:34.009466 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824e1a-eb41-4af2-a7f8-544c0570eb92 service glance] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.014800 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4ac09-1a7d-40d9-94a2-869a0b5908b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.015438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ac09-1a7d-40d9-94a2-869a0b5908b3 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.015727 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ac09-1a7d-40d9-94a2-869a0b5908b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.016006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ac09-1a7d-40d9-94a2-869a0b5908b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.024124 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4ac09-1a7d-40d9-94a2-869a0b5908b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.025717 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4ac09-1a7d-40d9-94a2-869a0b5908b3 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.033945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1356/2737] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:51:34.706944 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.708393 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:34.782662 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755722-603e-40ba-a9b0-d72b93f5e6cc None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.789814 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e198c-57ba-4746-b774-a1bf5086fe3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.790557 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e198c-57ba-4746-b774-a1bf5086fe3b service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.790851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e198c-57ba-4746-b774-a1bf5086fe3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.791139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e198c-57ba-4746-b774-a1bf5086fe3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.793362 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c13e198c-57ba-4746-b774-a1bf5086fe3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:34.824102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.891949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e198c-57ba-4746-b774-a1bf5086fe3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.893426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e198c-57ba-4746-b774-a1bf5086fe3b service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.906368 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1382/2738] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:51:44.030722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=39 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:44.899047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=21 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:45.144456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d33a-a4f2-4915-a9bb-0de81453c886 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.144979 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d33a-a4f2-4915-a9bb-0de81453c886 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.145078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d33a-a4f2-4915-a9bb-0de81453c886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.162929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-75e5d33a-a4f2-4915-a9bb-0de81453c886 None None] MFA Rules not processed for user `9683f1d0bf204dc1832786db1a4c756f`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:45.164119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-75e5d33a-a4f2-4915-a9bb-0de81453c886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:45.171010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1357/2739] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:51:48.624110 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676765e6-0cf4-4dc4-9b20-d77b14af2322 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.624564 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676765e6-0cf4-4dc4-9b20-d77b14af2322 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.624666 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676765e6-0cf4-4dc4-9b20-d77b14af2322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.644448 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-676765e6-0cf4-4dc4-9b20-d77b14af2322 None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:48.645726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-676765e6-0cf4-4dc4-9b20-d77b14af2322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:48.653186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1383/2740] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 19 21:51:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:51:48.666349 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d33a-a4f2-4915-a9bb-0de81453c886 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.679564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d33a-a4f2-4915-a9bb-0de81453c886 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.684684 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3a0e9-00be-48ee-bc53-bf25f17dcf12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.685336 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a0e9-00be-48ee-bc53-bf25f17dcf12 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.685621 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a0e9-00be-48ee-bc53-bf25f17dcf12 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.685901 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a0e9-00be-48ee-bc53-bf25f17dcf12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.694945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3a0e9-00be-48ee-bc53-bf25f17dcf12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:48.696575 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3a0e9-00be-48ee-bc53-bf25f17dcf12 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:48.706238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1358/2741] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:51:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:51:58.637071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:58.702415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=9 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:13.656953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676765e6-0cf4-4dc4-9b20-d77b14af2322 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:13.668192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676765e6-0cf4-4dc4-9b20-d77b14af2322 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:13.671807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:13.672454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.672735 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.673008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.684622 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:13.686204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:13.696699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1384/2742] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:52:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:52:15.442153 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.445213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.445213 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.461833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] MFA Rules not processed for user `c9e2963a1b3b424a96f85c7b1e77934b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:15.463162 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:15.520943 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1359/2743] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:52:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:52:16.234692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.234692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:16.343053 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144869-d488-40b2-929d-d6595558aa68 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.371008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fa0da-d7d2-40b0-b096-44e28005f79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.371873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa0da-d7d2-40b0-b096-44e28005f79a service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.372485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa0da-d7d2-40b0-b096-44e28005f79a service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.372485 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa0da-d7d2-40b0-b096-44e28005f79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.376904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-817fa0da-d7d2-40b0-b096-44e28005f79a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:16.392255 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fa0da-d7d2-40b0-b096-44e28005f79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.395060 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fa0da-d7d2-40b0-b096-44e28005f79a service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.407827 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1385/2744] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:52:25.513854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=25 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:26.402094 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=40 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:28.399409 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:28.400804 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:28.469357 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571d499-78c9-420a-b434-f23da76c32d6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:28.474871 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:28.475509 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:28.475788 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:28.476069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:28.477803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:28.489594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:28.491241 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:28.501136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1360/2745] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:52:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:52:38.496888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=32 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.644434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e457-f806-4f27-b98d-de3e100ffaf6 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.645961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e457-f806-4f27-b98d-de3e100ffaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.645961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e457-f806-4f27-b98d-de3e100ffaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.663676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-8674e457-f806-4f27-b98d-de3e100ffaf6 None None] MFA Rules not processed for user `c9e2963a1b3b424a96f85c7b1e77934b`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:21.664908 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8674e457-f806-4f27-b98d-de3e100ffaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:21.671835 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1386/2746] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:53:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:53:31.658245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:50.170541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:50.179921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ec4c-2de5-42b6-9100-05eb2db55d4e service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:50.183593 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc77a9-ba88-4b05-a262-6a2e09f6bc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:50.184217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc77a9-ba88-4b05-a262-6a2e09f6bc8a service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:50.184504 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc77a9-ba88-4b05-a262-6a2e09f6bc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:50.184781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc77a9-ba88-4b05-a262-6a2e09f6bc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:50.187109 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-69cc77a9-ba88-4b05-a262-6a2e09f6bc8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:50.197003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc77a9-ba88-4b05-a262-6a2e09f6bc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:50.198675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc77a9-ba88-4b05-a262-6a2e09f6bc8a service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:50.207957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1361/2747] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:53:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:53:50.283937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e457-f806-4f27-b98d-de3e100ffaf6 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:50.293910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e457-f806-4f27-b98d-de3e100ffaf6 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:50.297477 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:50.298118 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:50.298446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:50.298743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:50.300488 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:50.314187 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:50.315595 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:50.326957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1387/2748] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:53:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:53:51.081110 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a41da-fe65-43ff-89d2-06977d3c6d74 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:51.081407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a41da-fe65-43ff-89d2-06977d3c6d74 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:51.081690 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a41da-fe65-43ff-89d2-06977d3c6d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:51.101043 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-952a41da-fe65-43ff-89d2-06977d3c6d74 None None] MFA Rules not processed for user `13b68cce32bf48c283ea53cb65f4e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:51.102277 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-952a41da-fe65-43ff-89d2-06977d3c6d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:51.110337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1362/2749] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 19 21:53:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:53:51.149550 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:51.161852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b20bae-b3a7-4882-867e-57fb78ed4dc4 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:51.166885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af877878304440b9aa24964dedfadf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:51.167561 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:51.172008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:51.172008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:51.176758 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:51.178405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:51.186450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1388/2750] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 19 21:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:54:00.155968 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a41da-fe65-43ff-89d2-06977d3c6d74 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:00.219270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a41da-fe65-43ff-89d2-06977d3c6d74 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:00.223758 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:00.224617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:00.224899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:00.225183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] PATH_INFO: `/v3/users/9683f1d0bf204dc1832786db1a4c756f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:00.226393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9683f1d0bf204dc1832786db1a4c756f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:00.228307 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:00.413859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9683f1d0bf204dc1832786db1a4c756f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:00.421320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9683f1d0bf204dc1832786db1a4c756f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:00.486263 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9683f1d0bf204dc1832786db1a4c756f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:00.499480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9683f1d0bf204dc1832786db1a4c756f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:00.500142 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9683f1d0bf204dc1832786db1a4c756f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:00.506271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1363/2751] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:54:00 2022] DELETE /identity/v3/users/9683f1d0bf204dc1832786db1a4c756f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:54:00.739831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:00.751567 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cf3a3-d794-4974-bffa-4f88cc7f1cdf service swift] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:00.808729 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:00.809599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:00.809886 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:00.810173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] PATH_INFO: `/v3/projects/fd72c8bc35224d4fa54af047f0bf3f49` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:00.814355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd72c8bc35224d4fa54af047f0bf3f49)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:00.814355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:00.943155 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd72c8bc35224d4fa54af047f0bf3f49', 'request_id': 'req-360a2d1c-5794-4241-a62f-f01ddad192d1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:00.948580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd72c8bc35224d4fa54af047f0bf3f49', 'request_id': 'req-360a2d1c-5794-4241-a62f-f01ddad192d1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.030982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd72c8bc35224d4fa54af047f0bf3f49', 'request_id': 'req-360a2d1c-5794-4241-a62f-f01ddad192d1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.042900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] The token cache is being invalidate because project fd72c8bc35224d4fa54af047f0bf3f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:54:01.043192 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.043845 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.048479 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1389/2752] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:54:00 2022] DELETE /identity/v3/projects/fd72c8bc35224d4fa54af047f0bf3f49 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:54:01.049858 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:01.051340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:01.064447 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f160e38-e49e-4f03-883d-82c7d46df35c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:01.137120 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:01.138731 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:01.138872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:01.139211 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] PATH_INFO: `/v3/users/727a5d1960f641f8934c62800c1f522b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:01.140334 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=727a5d1960f641f8934c62800c1f522b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:01.142415 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:01.143918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:01.317185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727a5d1960f641f8934c62800c1f522b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.324491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727a5d1960f641f8934c62800c1f522b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.396313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727a5d1960f641f8934c62800c1f522b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.408674 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727a5d1960f641f8934c62800c1f522b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.409448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6373ce7f-0c32-413b-8a44-d362094da19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727a5d1960f641f8934c62800c1f522b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.415499 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1364/2753] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:54:01 2022] DELETE /identity/v3/users/727a5d1960f641f8934c62800c1f522b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:54:01.647758 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:01.650288 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:01.663686 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a2d1c-5794-4241-a62f-f01ddad192d1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:01.721580 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:01.722480 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:01.722766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:01.723051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] PATH_INFO: `/v3/projects/9e69bdf8e6404b70923194ebc35bce3a` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:01.724228 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e69bdf8e6404b70923194ebc35bce3a)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:01.726152 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:01.732975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:01.834549 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e69bdf8e6404b70923194ebc35bce3a', 'request_id': 'req-09ae9565-18a9-4f43-903a-9740e4f54653'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.839901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e69bdf8e6404b70923194ebc35bce3a', 'request_id': 'req-09ae9565-18a9-4f43-903a-9740e4f54653'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.903487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e69bdf8e6404b70923194ebc35bce3a', 'request_id': 'req-09ae9565-18a9-4f43-903a-9740e4f54653'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.914513 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] The token cache is being invalidate because project 9e69bdf8e6404b70923194ebc35bce3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:54:01.914801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.915435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:54:01.916964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1390/2754] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:54:01 2022] DELETE /identity/v3/projects/9e69bdf8e6404b70923194ebc35bce3a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:54:11.411777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:11.921206 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:25.986443 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:25.986935 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:25.987057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:26.004440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] MFA Rules not processed for user `c9e2963a1b3b424a96f85c7b1e77934b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:26.005572 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:26.059778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1365/2755] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:54:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:54:26.096371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:26.097762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:26.153419 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9565-18a9-4f43-903a-9740e4f54653 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:26.157003 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013746216dae469180f001d17ef6374e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:26.157638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:26.157920 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:26.158196 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:26.159972 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:26.229257 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:26.230743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:26.241648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1391/2756] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:54:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:54:26.915905 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:26.917296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:26.974970 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406baca8-d66e-491c-a23a-e1776e60987c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:26.978574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:26.979251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:26.979590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:26.979962 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:26.981708 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:26.995948 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:26.997393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:27.013215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1366/2757] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:54:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:54:36.236667 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=54 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:37.003581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=51 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:17.944751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:17.953897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0fdcb-ef08-4d5d-8bbf-2631e7f4fc0a service glance] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:17.957446 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:17.958078 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:17.958408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:17.958684 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:17.960544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:17.969846 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:17.975578 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:17.979658 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1392/2758] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:18.987759 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:18.989776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:19.004623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d842bd-5b0c-44d7-a7c6-24081a37df5f service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:19.010144 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:19.010818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:19.011108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:19.011392 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:19.013203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:19.026346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:19.027872 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:19.039512 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1367/2759] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:27.976236 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=6 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:29.034235 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:29.704816 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:29.706574 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:29.785177 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41403c-d4be-465e-8a8a-76ae29fe38e1 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:29.791038 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:29.794295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:29.794295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:29.794295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] PATH_INFO: `/v3/users/a74caf83bb2642059665cde2cf6112b6` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:29.794295 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74caf83bb2642059665cde2cf6112b6)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:29.796945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:30.086865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74caf83bb2642059665cde2cf6112b6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.093726 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74caf83bb2642059665cde2cf6112b6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.094407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74caf83bb2642059665cde2cf6112b6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.095002 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74caf83bb2642059665cde2cf6112b6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.158949 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74caf83bb2642059665cde2cf6112b6'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.178033 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1393/2760] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:55:29 2022] DELETE /identity/v3/users/a74caf83bb2642059665cde2cf6112b6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:30.414712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:30.425506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde64fc-9402-4bc9-8773-f6f5e650280f service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:30.484182 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:30.485042 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:30.485332 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:30.485612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] PATH_INFO: `/v3/projects/be746dfba6514b3e9d9e27f794f68196` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:30.486969 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be746dfba6514b3e9d9e27f794f68196)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:30.488896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:30.612557 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be746dfba6514b3e9d9e27f794f68196', 'request_id': 'req-6ebd4948-67c2-4077-80cb-dcdecc089607'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.618016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be746dfba6514b3e9d9e27f794f68196', 'request_id': 'req-6ebd4948-67c2-4077-80cb-dcdecc089607'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.695732 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be746dfba6514b3e9d9e27f794f68196', 'request_id': 'req-6ebd4948-67c2-4077-80cb-dcdecc089607'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.707327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] The token cache is being invalidate because project be746dfba6514b3e9d9e27f794f68196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:55:30.707620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.708811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.710388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1368/2761] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:55:30 2022] DELETE /identity/v3/projects/be746dfba6514b3e9d9e27f794f68196 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:30.714375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:30.715834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:30.728704 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b0e9f-8440-480c-9f86-d8535e38422b admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:30.807646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:30.807646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:30.807646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:30.807646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] PATH_INFO: `/v3/users/9e36da7c77984469a2668c0c8c2460ff` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:30.812435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e36da7c77984469a2668c0c8c2460ff)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:30.813001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:30.837694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:30.971357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e36da7c77984469a2668c0c8c2460ff'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.978733 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e36da7c77984469a2668c0c8c2460ff'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.979402 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e36da7c77984469a2668c0c8c2460ff'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:30.980020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e36da7c77984469a2668c0c8c2460ff'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:31.058173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e36da7c77984469a2668c0c8c2460ff'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:31.077129 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1394/2762] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:55:30 2022] DELETE /identity/v3/users/9e36da7c77984469a2668c0c8c2460ff => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:31.355100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:31.356529 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:31.369650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd4948-67c2-4077-80cb-dcdecc089607 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:31.438436 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:31.439323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:31.439608 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:31.439888 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] PATH_INFO: `/v3/projects/73bf605cdb21473d87a7d7d32c29fd35` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:31.441163 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bf605cdb21473d87a7d7d32c29fd35)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:31.450565 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:31.557190 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:31.570271 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bf605cdb21473d87a7d7d32c29fd35', 'request_id': 'req-50422ce8-f44b-4713-b7df-090b44de10b8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:31.575903 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bf605cdb21473d87a7d7d32c29fd35', 'request_id': 'req-50422ce8-f44b-4713-b7df-090b44de10b8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:31.644262 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bf605cdb21473d87a7d7d32c29fd35', 'request_id': 'req-50422ce8-f44b-4713-b7df-090b44de10b8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:31.657352 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] The token cache is being invalidate because project 73bf605cdb21473d87a7d7d32c29fd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:55:31.657643 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:31.658327 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:31.660006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1369/2763] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:55:31 2022] DELETE /identity/v3/projects/73bf605cdb21473d87a7d7d32c29fd35 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:34.858378 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:34.860230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:34.876369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00598b-0d0a-4895-884e-04f7e1bad4f3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:34.932425 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:34.933230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:34.933519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:34.933805 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] PATH_INFO: `/v3/users/c9e2963a1b3b424a96f85c7b1e77934b` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:34.935025 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e2963a1b3b424a96f85c7b1e77934b)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:34.936964 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:35.156205 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e2963a1b3b424a96f85c7b1e77934b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.163421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e2963a1b3b424a96f85c7b1e77934b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.164083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e2963a1b3b424a96f85c7b1e77934b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.164812 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e2963a1b3b424a96f85c7b1e77934b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.258508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-38d60db9-ceb1-4377-ad3c-4aa62eee59fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e2963a1b3b424a96f85c7b1e77934b'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.276679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1395/2764] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:55:34 2022] DELETE /identity/v3/users/c9e2963a1b3b424a96f85c7b1e77934b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:35.518372 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:35.519852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:35.532933 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50422ce8-f44b-4713-b7df-090b44de10b8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:35.592762 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:35.593671 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:35.593957 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:35.594267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] PATH_INFO: `/v3/projects/e767a71e041048a096cd9ebe3090b8b5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:35.595507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e767a71e041048a096cd9ebe3090b8b5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:35.597534 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:35.727178 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e767a71e041048a096cd9ebe3090b8b5', 'request_id': 'req-49e56bc5-0782-4280-bf5d-ef076b536ca2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.732694 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e767a71e041048a096cd9ebe3090b8b5', 'request_id': 'req-49e56bc5-0782-4280-bf5d-ef076b536ca2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.838478 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e767a71e041048a096cd9ebe3090b8b5', 'request_id': 'req-49e56bc5-0782-4280-bf5d-ef076b536ca2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.850111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] The token cache is being invalidate because project e767a71e041048a096cd9ebe3090b8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:55:35.850423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.851146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-49e56bc5-0782-4280-bf5d-ef076b536ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:35.852703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1370/2765] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:55:35 2022] DELETE /identity/v3/projects/e767a71e041048a096cd9ebe3090b8b5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:35.857695 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea117-0e8e-4d77-9319-12fbbcca4f30 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:35.857988 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea117-0e8e-4d77-9319-12fbbcca4f30 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:35.858296 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea117-0e8e-4d77-9319-12fbbcca4f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:35.877450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-c8dea117-0e8e-4d77-9319-12fbbcca4f30 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:35.878676 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c8dea117-0e8e-4d77-9319-12fbbcca4f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:35.891158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:35.940121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1396/2766] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:35.947898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356746a-fd91-42c9-9b87-6f0af65e94db None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:35.948212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356746a-fd91-42c9-9b87-6f0af65e94db None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:35.948495 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356746a-fd91-42c9-9b87-6f0af65e94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:35.966937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d356746a-fd91-42c9-9b87-6f0af65e94db None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:35.968459 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d356746a-fd91-42c9-9b87-6f0af65e94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:35.976612 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1371/2767] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:35.980768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dea117-0e8e-4d77-9319-12fbbcca4f30 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:35.990687 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dea117-0e8e-4d77-9319-12fbbcca4f30 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:35.995408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:35.996087 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:35.996369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:35.996644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:35.997359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:35.997669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:35.999320 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:36.010798 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1397/2768] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:55:36.014832 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356746a-fd91-42c9-9b87-6f0af65e94db None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:36.024390 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356746a-fd91-42c9-9b87-6f0af65e94db None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:36.029207 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:36.029841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:36.030126 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:36.030440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:36.031129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:36.033019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:36.148817 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1372/2769] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:55:36 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:36.159407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:36.169867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec060-da6d-438e-86a3-6faaeb600c43 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:36.224299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:36.225039 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:36.225328 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:36.225598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:36.226307 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:36.228200 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:36.330657 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1398/2770] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:55:36 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:36.335098 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:36.345724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36604a0-4f8d-4e56-91c2-806764609d8d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:36.350449 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:36.351135 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:36.351422 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:36.351704 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:36.352425 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:36.354020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:36.364311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1373/2771] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:36.368010 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:36.377732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c976a5-551a-4986-96c6-8ab0aa53b47c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:36.382897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f165-c497-4670-ad6f-ab0d1ca8b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:36.383543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f165-c497-4670-ad6f-ab0d1ca8b565 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:36.383828 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f165-c497-4670-ad6f-ab0d1ca8b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:36.384108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f165-c497-4670-ad6f-ab0d1ca8b565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:36.384826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f165-c497-4670-ad6f-ab0d1ca8b565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:36.386450 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f165-c497-4670-ad6f-ab0d1ca8b565 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:36.396776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1399/2772] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:36.400879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:36.410522 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e08b5-3ef9-4853-b2a0-7fc016779107 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:36.415137 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:36.415997 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:36.416281 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:36.416558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] PATH_INFO: `/v3/projects/9179957a6ab34019a89f30ce8b04ceb5/users/172d9715e63e485fbcd02078aeb6edc8/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:36.424340 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:36.430893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9179957a6ab34019a89f30ce8b04ceb5, user_id=172d9715e63e485fbcd02078aeb6edc8, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:36.433545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:36.513114 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1374/2773] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:55:36 2022] PUT /identity/v3/projects/9179957a6ab34019a89f30ce8b04ceb5/users/172d9715e63e485fbcd02078aeb6edc8/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:36.529713 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ecce-cd6c-47b9-9ba6-74a5b532eef2 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:36.530034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ecce-cd6c-47b9-9ba6-74a5b532eef2 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:36.530341 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ecce-cd6c-47b9-9ba6-74a5b532eef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:36.558359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1d51ecce-cd6c-47b9-9ba6-74a5b532eef2 None None] MFA Rules not processed for user `172d9715e63e485fbcd02078aeb6edc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:36.559569 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1d51ecce-cd6c-47b9-9ba6-74a5b532eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:36.623554 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1400/2774] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:36.635426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:36.637086 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:36.709774 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c29cc-ae26-447b-a46b-54e3515a90dd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:36.715712 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec665e74-c7e0-406a-b294-80d30f7f55fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:36.716382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec665e74-c7e0-406a-b294-80d30f7f55fe service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:36.716667 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec665e74-c7e0-406a-b294-80d30f7f55fe service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:36.716982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec665e74-c7e0-406a-b294-80d30f7f55fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:36.724658 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec665e74-c7e0-406a-b294-80d30f7f55fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:36.726391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec665e74-c7e0-406a-b294-80d30f7f55fe service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:36.734985 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1375/2775] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:39.854367 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ecce-cd6c-47b9-9ba6-74a5b532eef2 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:39.865715 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:39.915306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ecce-cd6c-47b9-9ba6-74a5b532eef2 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:39.920088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:39.920953 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:39.921238 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:39.921543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] PATH_INFO: `/v3/users/172d9715e63e485fbcd02078aeb6edc8` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:39.922815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=172d9715e63e485fbcd02078aeb6edc8)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:39.925199 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:40.157685 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172d9715e63e485fbcd02078aeb6edc8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:40.164614 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172d9715e63e485fbcd02078aeb6edc8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:40.165270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172d9715e63e485fbcd02078aeb6edc8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:40.165864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172d9715e63e485fbcd02078aeb6edc8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:40.243795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172d9715e63e485fbcd02078aeb6edc8'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:40.262162 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1401/2776] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:55:39 2022] DELETE /identity/v3/users/172d9715e63e485fbcd02078aeb6edc8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:40.267039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:40.267519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:40.267622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:40.286506 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:40.287719 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:40.347053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1376/2777] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:55:40.356631 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:40.358037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:40.413121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d52ae-8d0b-461a-9785-b24da8680cba admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:40.416571 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537af5c6-358b-4f13-84c2-cf592e004b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:40.417201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537af5c6-358b-4f13-84c2-cf592e004b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:40.417481 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537af5c6-358b-4f13-84c2-cf592e004b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:40.417756 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537af5c6-358b-4f13-84c2-cf592e004b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:40.426533 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537af5c6-358b-4f13-84c2-cf592e004b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:40.427952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537af5c6-358b-4f13-84c2-cf592e004b7b service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:40.437148 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1402/2778] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:40.826006 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:40.827543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:40.840322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751ea04-d018-4acc-a0d5-aef9201c1a59 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:40.845155 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:40.846022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:40.846347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:40.846633 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] PATH_INFO: `/v3/projects/9179957a6ab34019a89f30ce8b04ceb5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:40.848730 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9179957a6ab34019a89f30ce8b04ceb5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:40.850696 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:40.947296 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9179957a6ab34019a89f30ce8b04ceb5', 'request_id': 'req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:40.952700 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9179957a6ab34019a89f30ce8b04ceb5', 'request_id': 'req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:41.018184 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9179957a6ab34019a89f30ce8b04ceb5', 'request_id': 'req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:41.020323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:41.029735 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] The token cache is being invalidate because project 9179957a6ab34019a89f30ce8b04ceb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:55:41.030021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:41.030659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b4d61b34-76f8-4d80-8fcf-f9acc8eb6eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:41.032183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1377/2779] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:55:40 2022] DELETE /identity/v3/projects/9179957a6ab34019a89f30ce8b04ceb5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:41.037750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97480-1dcc-4a5f-a943-5131f8d03864 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.038245 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97480-1dcc-4a5f-a943-5131f8d03864 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.038366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97480-1dcc-4a5f-a943-5131f8d03864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.056433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-2ae97480-1dcc-4a5f-a943-5131f8d03864 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:41.057678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2ae97480-1dcc-4a5f-a943-5131f8d03864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:41.087452 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:41.116256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1403/2780] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:41.124345 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1e58-cb6a-433f-b89e-d0fa80ad240a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.124644 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1e58-cb6a-433f-b89e-d0fa80ad240a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.124958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1e58-cb6a-433f-b89e-d0fa80ad240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.143174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1d3d1e58-cb6a-433f-b89e-d0fa80ad240a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:41.144366 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1d3d1e58-cb6a-433f-b89e-d0fa80ad240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:41.152765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1378/2781] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:41.157047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97480-1dcc-4a5f-a943-5131f8d03864 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:41.167313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97480-1dcc-4a5f-a943-5131f8d03864 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:41.172006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:41.172654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.172938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.173216 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.173932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:41.174270 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:41.175859 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:41.187629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1404/2782] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:41.191803 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d1e58-cb6a-433f-b89e-d0fa80ad240a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:41.201614 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d1e58-cb6a-433f-b89e-d0fa80ad240a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:41.206344 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:41.206995 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.207282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.208164 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.208853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:41.210778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:41.299713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1379/2783] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:55:41 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:41.304359 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:41.314465 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5ab93-a0c4-4a83-964d-1fcb94d9d3f4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:41.369438 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:41.370120 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.370434 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.370718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.371426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:41.373385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:41.458091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1405/2784] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:55:41 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:41.461786 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:41.472073 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525ee2-af6d-47ef-b7af-a6fd891e5abd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:41.476574 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:41.477215 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.478008 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.478317 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.479029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:41.480616 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:41.491244 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1380/2785] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:41.495852 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:41.505750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c375a-f217-4344-8315-e8081d5373dd admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:41.510491 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f346ee-8086-4cfd-a494-02f96a03c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:41.511137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f346ee-8086-4cfd-a494-02f96a03c214 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.511426 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f346ee-8086-4cfd-a494-02f96a03c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.511707 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f346ee-8086-4cfd-a494-02f96a03c214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.512428 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f346ee-8086-4cfd-a494-02f96a03c214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:41.514075 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f346ee-8086-4cfd-a494-02f96a03c214 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:41.524009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1406/2786] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:41.528131 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:41.537849 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b203b-26a2-4265-91b8-71a06792c629 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:41.544847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:41.544847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.544847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.544847 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] PATH_INFO: `/v3/projects/3ff714c887d24dd9a1983d2f75829640/users/28616ffab565404c9e925e5ea3b51035/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.562119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff714c887d24dd9a1983d2f75829640, user_id=28616ffab565404c9e925e5ea3b51035, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:41.564954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:41.704382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1381/2787] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:55:41 2022] PUT /identity/v3/projects/3ff714c887d24dd9a1983d2f75829640/users/28616ffab565404c9e925e5ea3b51035/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:41.714890 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5cb4-87bf-4596-9991-5b8ec0a8a401 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.715121 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5cb4-87bf-4596-9991-5b8ec0a8a401 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.715398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5cb4-87bf-4596-9991-5b8ec0a8a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.742604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-7f2c5cb4-87bf-4596-9991-5b8ec0a8a401 None None] MFA Rules not processed for user `28616ffab565404c9e925e5ea3b51035`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:41.744423 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-7f2c5cb4-87bf-4596-9991-5b8ec0a8a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:41.806510 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1407/2788] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:41.811003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:41.871328 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3338a-60c9-4b07-9cc4-d205c1f87e21 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:41.875937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:41.876587 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:41.876866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:41.877140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:41.877818 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:41.879746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:41.986185 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1382/2789] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:55:41 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:41.989909 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5cb4-87bf-4596-9991-5b8ec0a8a401 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:42.000834 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5cb4-87bf-4596-9991-5b8ec0a8a401 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:42.030538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:42.057128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:42.057788 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.058070 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.058374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.059061 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:42.060983 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:42.183576 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1408/2790] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:55:41 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:42.188351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:42.199976 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1976216-e7d8-4686-86c9-63ea10fa40bf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:42.205883 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:42.206584 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.206874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.207149 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.207870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:42.209471 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:42.221373 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1383/2791] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:42.225532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:42.236498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89085c6f-103b-458a-9fed-76f8e8a5078f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:42.241135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:42.242001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.242318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.242598 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] PATH_INFO: `/v3/projects/7fca2513ff834c97939501cc54074552/users/974ebff2832c482da298ae51b66141a1/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.257356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fca2513ff834c97939501cc54074552, user_id=974ebff2832c482da298ae51b66141a1, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:42.260628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:42.370005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1409/2792] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:55:42 2022] PUT /identity/v3/projects/7fca2513ff834c97939501cc54074552/users/974ebff2832c482da298ae51b66141a1/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:42.373972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:42.384591 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621737d-b747-44d8-bd34-426eb67268dc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:42.440195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94cafe-e0c6-4166-821f-4f16f51bd08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:42.440855 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94cafe-e0c6-4166-821f-4f16f51bd08a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.441140 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94cafe-e0c6-4166-821f-4f16f51bd08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.441418 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94cafe-e0c6-4166-821f-4f16f51bd08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.442127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94cafe-e0c6-4166-821f-4f16f51bd08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:42.443743 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94cafe-e0c6-4166-821f-4f16f51bd08a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:42.453787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1384/2793] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:42.457981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:42.468947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f94a2-402f-44be-a7c4-40dc2e849727 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:42.473565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:42.474460 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.474749 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.475029 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] PATH_INFO: `/v3/projects/7fca2513ff834c97939501cc54074552/users/974ebff2832c482da298ae51b66141a1/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.476989 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fca2513ff834c97939501cc54074552, user_id=974ebff2832c482da298ae51b66141a1, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:42.479787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:42.500247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1410/2794] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:55:42 2022] PUT /identity/v3/projects/7fca2513ff834c97939501cc54074552/users/974ebff2832c482da298ae51b66141a1/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:42.511511 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb2ee-1e33-4c63-b193-9dd4eb7e71e2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.511848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb2ee-1e33-4c63-b193-9dd4eb7e71e2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.512087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb2ee-1e33-4c63-b193-9dd4eb7e71e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.518005 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:42.542629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2dabb2ee-1e33-4c63-b193-9dd4eb7e71e2 None None] MFA Rules not processed for user `974ebff2832c482da298ae51b66141a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:42.543824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2dabb2ee-1e33-4c63-b193-9dd4eb7e71e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:42.611838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1385/2795] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:42.623626 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:42.625321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:42.681441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7eb0-1f1f-45cb-91dd-a5cc54cf5e02 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:42.685063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:42.685696 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.685980 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.686282 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.695072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:42.697124 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:42.706415 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1411/2796] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:42.877326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb2ee-1e33-4c63-b193-9dd4eb7e71e2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:42.887893 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb2ee-1e33-4c63-b193-9dd4eb7e71e2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:42.891544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217ead-6b9e-4b3f-b69b-b38413933e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:42.892250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217ead-6b9e-4b3f-b69b-b38413933e6d service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:42.892536 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217ead-6b9e-4b3f-b69b-b38413933e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:42.892814 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217ead-6b9e-4b3f-b69b-b38413933e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:42.949195 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217ead-6b9e-4b3f-b69b-b38413933e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:42.950672 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217ead-6b9e-4b3f-b69b-b38413933e6d service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:42.959445 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1386/2797] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:51.240995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:51.302847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aecba4-054d-4bec-9a01-73aa34345883 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:51.308036 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:51.308907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:51.309193 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:51.309467 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] PATH_INFO: `/v3/users/28616ffab565404c9e925e5ea3b51035` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:51.310680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28616ffab565404c9e925e5ea3b51035)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:51.312885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:51.436801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:51.545791 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28616ffab565404c9e925e5ea3b51035'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:51.552616 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28616ffab565404c9e925e5ea3b51035'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:51.553279 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28616ffab565404c9e925e5ea3b51035'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:51.553888 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28616ffab565404c9e925e5ea3b51035'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:51.675020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28616ffab565404c9e925e5ea3b51035'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:51.692376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1412/2798] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:55:51 2022] DELETE /identity/v3/users/28616ffab565404c9e925e5ea3b51035 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:51.696841 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:51.697395 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:51.697395 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:51.718313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:51.719549 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:51.777812 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1387/2799] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:51.787390 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:51.788781 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:51.844993 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f5f14-c8db-49b4-b198-11cf90bddb1a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:51.848500 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:51.849140 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:51.849427 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:51.849706 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:51.859170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:51.860609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:51.869981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1413/2800] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:52.297099 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:52.298543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:52.311051 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e04f24-4b00-467c-b87d-14a89bda06fd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:52.315675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:52.316541 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:52.316827 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:52.317101 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] PATH_INFO: `/v3/projects/3ff714c887d24dd9a1983d2f75829640` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:52.318320 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff714c887d24dd9a1983d2f75829640)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:52.320255 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:52.343632 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:52.433089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff714c887d24dd9a1983d2f75829640', 'request_id': 'req-5c0b119b-b9f8-47bd-96c7-64c98ae07016'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.438552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff714c887d24dd9a1983d2f75829640', 'request_id': 'req-5c0b119b-b9f8-47bd-96c7-64c98ae07016'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.512419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff714c887d24dd9a1983d2f75829640', 'request_id': 'req-5c0b119b-b9f8-47bd-96c7-64c98ae07016'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.523571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] The token cache is being invalidate because project 3ff714c887d24dd9a1983d2f75829640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:55:52.523866 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.524500 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.526437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1388/2801] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:55:52 2022] DELETE /identity/v3/projects/3ff714c887d24dd9a1983d2f75829640 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:52.530539 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:52.540229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d00d0-0af5-4d1a-a45d-71a1072e25c3 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:52.610813 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:52.611754 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:52.612034 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:52.612306 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] PATH_INFO: `/v3/users/974ebff2832c482da298ae51b66141a1` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:52.613504 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=974ebff2832c482da298ae51b66141a1)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:52.615902 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:52.799630 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974ebff2832c482da298ae51b66141a1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.801472 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:52.807224 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974ebff2832c482da298ae51b66141a1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.807873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974ebff2832c482da298ae51b66141a1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.808469 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974ebff2832c482da298ae51b66141a1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.903807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-f68eedd8-19a5-46b2-b9a7-ebc8412862dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974ebff2832c482da298ae51b66141a1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:52.922330 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1414/2802] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:55:52 2022] DELETE /identity/v3/users/974ebff2832c482da298ae51b66141a1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:53.327886 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:53.329356 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:53.342738 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b119b-b9f8-47bd-96c7-64c98ae07016 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:53.399581 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:53.401205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:53.401492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:53.401772 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] PATH_INFO: `/v3/projects/7fca2513ff834c97939501cc54074552` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:53.403010 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fca2513ff834c97939501cc54074552)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:53.405007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:53.506224 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fca2513ff834c97939501cc54074552', 'request_id': 'req-18cc44d7-d514-40e9-ac6c-9153fda325ce'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:53.512354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fca2513ff834c97939501cc54074552', 'request_id': 'req-18cc44d7-d514-40e9-ac6c-9153fda325ce'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:53.569245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fca2513ff834c97939501cc54074552', 'request_id': 'req-18cc44d7-d514-40e9-ac6c-9153fda325ce'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:53.581225 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] The token cache is being invalidate because project 7fca2513ff834c97939501cc54074552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:55:53.581518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:53.582156 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18cc44d7-d514-40e9-ac6c-9153fda325ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:55:53.583874 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1389/2803] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:55:53 2022] DELETE /identity/v3/projects/7fca2513ff834c97939501cc54074552 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:53.589596 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead498c-7403-4726-858b-f80100bee4f3 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:53.590091 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead498c-7403-4726-858b-f80100bee4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:53.590195 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead498c-7403-4726-858b-f80100bee4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:53.607496 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0ead498c-7403-4726-858b-f80100bee4f3 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:53.608698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0ead498c-7403-4726-858b-f80100bee4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:53.667109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1415/2804] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:53.674952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e84a-e589-48a8-b75e-e30953968218 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:53.675245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e84a-e589-48a8-b75e-e30953968218 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:53.675527 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e84a-e589-48a8-b75e-e30953968218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:53.693423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ab90e84a-e589-48a8-b75e-e30953968218 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:53.694657 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ab90e84a-e589-48a8-b75e-e30953968218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:53.703723 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1390/2805] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:55:53.707717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead498c-7403-4726-858b-f80100bee4f3 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:53.717796 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead498c-7403-4726-858b-f80100bee4f3 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:53.722325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:53.722970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:53.723252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:53.723531 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:53.724241 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:53.724547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:53.726134 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:53.740005 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1416/2806] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:53.744954 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e84a-e589-48a8-b75e-e30953968218 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:53.754388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e84a-e589-48a8-b75e-e30953968218 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:53.759041 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:53.759716 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:53.759998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:53.760275 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:53.760958 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:53.762876 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:53.874778 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1391/2807] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:55:53 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:53.878154 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:53.888067 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc6f7-fc10-4d3e-9c0b-c36193f32f0a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:53.943398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:53.944059 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:53.944344 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:53.944620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:53.945311 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:53.947260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.020732 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1417/2808] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:55:53 2022] POST /identity/v3/users => generated 278 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:55:54.025580 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.035930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aea22b-f3b4-45c7-b82a-aeed6af8cf5f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.040564 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.041974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.042123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.042440 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.043159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.044747 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.049852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:54.055321 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1392/2809] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:54.059281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.070098 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7038e-51c6-40ca-b76f-01bd4d64181a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.075128 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0acab-a9e3-47da-97b2-47fa9195b131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.075785 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0acab-a9e3-47da-97b2-47fa9195b131 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.076084 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0acab-a9e3-47da-97b2-47fa9195b131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.076365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0acab-a9e3-47da-97b2-47fa9195b131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.077202 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0acab-a9e3-47da-97b2-47fa9195b131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.078941 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0acab-a9e3-47da-97b2-47fa9195b131 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.090064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1418/2810] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:54.094186 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.104420 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690345d-7207-4765-a12a-18c3507c41d1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.109058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.109922 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.110226 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.110515 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] PATH_INFO: `/v3/projects/afc849255d75402abc55dcad804eff34/users/2486e4dfe833431b841dfcadc01d0629/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.124982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc849255d75402abc55dcad804eff34, user_id=2486e4dfe833431b841dfcadc01d0629, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.127660 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.209720 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1393/2811] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:55:54 2022] PUT /identity/v3/projects/afc849255d75402abc55dcad804eff34/users/2486e4dfe833431b841dfcadc01d0629/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:55:54.220762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf7a3-e99d-48fe-a963-9bf27ba00a63 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.221058 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf7a3-e99d-48fe-a963-9bf27ba00a63 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.221338 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf7a3-e99d-48fe-a963-9bf27ba00a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.247246 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-763cf7a3-e99d-48fe-a963-9bf27ba00a63 None None] MFA Rules not processed for user `2486e4dfe833431b841dfcadc01d0629`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:54.248439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-763cf7a3-e99d-48fe-a963-9bf27ba00a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:54.268698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:54.314045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1419/2812] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:54 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:55:54.318547 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.379537 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d93a79-777e-468a-b1b0-4fb382cad1b0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.384830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.385516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.385797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.386072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.386816 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.388770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.465491 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1394/2813] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:55:54 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:54.469587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf7a3-e99d-48fe-a963-9bf27ba00a63 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.480475 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf7a3-e99d-48fe-a963-9bf27ba00a63 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.536699 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.537369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.537654 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.537930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.538650 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.540601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.621137 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1420/2814] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:55:54 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:54.625085 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.636018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea822f4-204d-41f2-985c-798b51ffc291 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.640551 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.641194 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.641475 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.641749 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.642497 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.644094 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.655795 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1395/2815] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:54.659857 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.669751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1004a-ea5d-4c85-9ce5-c6761e037424 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.674398 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.675283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.675568 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.675855 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] PATH_INFO: `/v3/projects/2406d8860cf24d2e8a29ac159e68c3e8/users/187dce5663b847179e727e804e5a99f0/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.690779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2406d8860cf24d2e8a29ac159e68c3e8, user_id=187dce5663b847179e727e804e5a99f0, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.693421 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.766807 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1421/2816] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:55:54 2022] PUT /identity/v3/projects/2406d8860cf24d2e8a29ac159e68c3e8/users/187dce5663b847179e727e804e5a99f0/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:54.770722 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.780776 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3052d4-47f2-4797-903d-41ce90e80a07 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.836446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2978101-6525-487a-b8e8-9e1ec6ae86bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.837106 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978101-6525-487a-b8e8-9e1ec6ae86bc admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.837395 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978101-6525-487a-b8e8-9e1ec6ae86bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.837702 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978101-6525-487a-b8e8-9e1ec6ae86bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.838446 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2978101-6525-487a-b8e8-9e1ec6ae86bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.840044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2978101-6525-487a-b8e8-9e1ec6ae86bc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.849930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1396/2817] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:55:54.854145 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:54.864523 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78acb05-dfcc-4059-b0c7-1840bc9be906 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:54.869762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:54.870697 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.870981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.871256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] PATH_INFO: `/v3/projects/2406d8860cf24d2e8a29ac159e68c3e8/users/187dce5663b847179e727e804e5a99f0/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.873222 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2406d8860cf24d2e8a29ac159e68c3e8, user_id=187dce5663b847179e727e804e5a99f0, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:54.876483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:54.887297 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1422/2818] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:55:54 2022] PUT /identity/v3/projects/2406d8860cf24d2e8a29ac159e68c3e8/users/187dce5663b847179e727e804e5a99f0/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:54.898518 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372d80-3b7b-4c6d-a635-ba0eba480059 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:54.898838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372d80-3b7b-4c6d-a635-ba0eba480059 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:54.899141 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372d80-3b7b-4c6d-a635-ba0eba480059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:54.924864 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ba372d80-3b7b-4c6d-a635-ba0eba480059 None None] MFA Rules not processed for user `187dce5663b847179e727e804e5a99f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:54.926066 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ba372d80-3b7b-4c6d-a635-ba0eba480059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:54.959479 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:54.994631 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1397/2819] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:55:54 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:55:55.006433 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:55.008198 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:55.064683 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333cd22-d38e-404b-b5a1-8fafee3bba3a admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:55.068309 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:55.068945 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:55.069227 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:55.069505 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:55.078384 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:55.079867 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:55.089443 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1423/2820] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:55 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:55:55.327823 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372d80-3b7b-4c6d-a635-ba0eba480059 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:55.337833 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372d80-3b7b-4c6d-a635-ba0eba480059 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:55.341929 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600d463-9775-44fe-b80b-e63583d7a5e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:55.346838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600d463-9775-44fe-b80b-e63583d7a5e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:55.346838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600d463-9775-44fe-b80b-e63583d7a5e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:55.346838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600d463-9775-44fe-b80b-e63583d7a5e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:55.399555 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600d463-9775-44fe-b80b-e63583d7a5e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:55.401870 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600d463-9775-44fe-b80b-e63583d7a5e8 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:55.410898 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1398/2821] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:55:55 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:05.085190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:05.406837 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=41 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:13.142880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:13.244897 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743288-39d8-4ec8-ad4b-f06fa8e4a969 service cinder] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:13.250008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:13.250904 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:13.251186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:13.251461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] PATH_INFO: `/v3/users/2486e4dfe833431b841dfcadc01d0629` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:13.252660 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2486e4dfe833431b841dfcadc01d0629)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:13.254610 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:13.439753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2486e4dfe833431b841dfcadc01d0629'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:13.446705 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2486e4dfe833431b841dfcadc01d0629'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:13.447376 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2486e4dfe833431b841dfcadc01d0629'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:13.447976 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2486e4dfe833431b841dfcadc01d0629'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:13.515139 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2486e4dfe833431b841dfcadc01d0629'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:13.532836 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1424/2822] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:56:13 2022] DELETE /identity/v3/users/2486e4dfe833431b841dfcadc01d0629 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:13.537351 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:13.541545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:13.541545 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:13.585293 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:13.586519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:13.647824 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1399/2823] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:13.657682 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:13.659220 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:13.701020 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:13.752096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134e76e-63a9-41ee-951b-2b9321a95cde admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:13.755644 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:13.756284 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:13.756565 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:13.756839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:13.765840 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:13.767451 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:13.777277 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1425/2824] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:14.157381 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:14.159171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:14.174981 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861205f0-cdd7-4e10-957d-ffb75f59876a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:14.181175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:14.182250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:14.182713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:14.183069 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] PATH_INFO: `/v3/projects/afc849255d75402abc55dcad804eff34` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:14.184799 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc849255d75402abc55dcad804eff34)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:14.187490 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:14.298790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc849255d75402abc55dcad804eff34', 'request_id': 'req-11a691d8-2e25-4679-aacd-8b7a05163d68'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.304260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc849255d75402abc55dcad804eff34', 'request_id': 'req-11a691d8-2e25-4679-aacd-8b7a05163d68'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.374313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc849255d75402abc55dcad804eff34', 'request_id': 'req-11a691d8-2e25-4679-aacd-8b7a05163d68'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.385573 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] The token cache is being invalidate because project afc849255d75402abc55dcad804eff34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:56:14.385860 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.386488 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.388016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1400/2825] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:56:14 2022] DELETE /identity/v3/projects/afc849255d75402abc55dcad804eff34 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:14.392559 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:14.402562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d388874-9d29-4ad5-a72c-277c3ab0ea9d service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:14.457751 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:14.458652 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:14.458932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:14.459203 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] PATH_INFO: `/v3/users/187dce5663b847179e727e804e5a99f0` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:14.460366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187dce5663b847179e727e804e5a99f0)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:14.462325 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:14.629141 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187dce5663b847179e727e804e5a99f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.643021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187dce5663b847179e727e804e5a99f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.643712 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187dce5663b847179e727e804e5a99f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.644318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187dce5663b847179e727e804e5a99f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.722884 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-0fbf03af-ed8b-4559-9698-ed368c8c7b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187dce5663b847179e727e804e5a99f0'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:14.740562 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1426/2826] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:56:14 2022] DELETE /identity/v3/users/187dce5663b847179e727e804e5a99f0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:15.133437 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.134861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:15.148274 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a691d8-2e25-4679-aacd-8b7a05163d68 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.205024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:15.210777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.211628 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.211912 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.212188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] PATH_INFO: `/v3/projects/2406d8860cf24d2e8a29ac159e68c3e8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.213346 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2406d8860cf24d2e8a29ac159e68c3e8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.215282 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.327448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2406d8860cf24d2e8a29ac159e68c3e8', 'request_id': 'req-6f26664b-0e42-492c-aa3d-a49a86b371c4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:15.332960 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2406d8860cf24d2e8a29ac159e68c3e8', 'request_id': 'req-6f26664b-0e42-492c-aa3d-a49a86b371c4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:15.400337 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2406d8860cf24d2e8a29ac159e68c3e8', 'request_id': 'req-6f26664b-0e42-492c-aa3d-a49a86b371c4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:15.411419 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] The token cache is being invalidate because project 2406d8860cf24d2e8a29ac159e68c3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:56:15.411650 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:15.412276 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6f26664b-0e42-492c-aa3d-a49a86b371c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:15.413853 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1401/2827] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:56:15 2022] DELETE /identity/v3/projects/2406d8860cf24d2e8a29ac159e68c3e8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:15.418883 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cd21a-b95f-41b0-a915-83f1d2e1ed28 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.423679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cd21a-b95f-41b0-a915-83f1d2e1ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.423679 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cd21a-b95f-41b0-a915-83f1d2e1ed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.456918 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-898cd21a-b95f-41b0-a915-83f1d2e1ed28 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:15.458116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-898cd21a-b95f-41b0-a915-83f1d2e1ed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:15.462253 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:15.517271 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1427/2828] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:15.525543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71116963-05c5-4b78-9259-43a8916bde08 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.525828 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71116963-05c5-4b78-9259-43a8916bde08 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.526100 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71116963-05c5-4b78-9259-43a8916bde08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.544961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-71116963-05c5-4b78-9259-43a8916bde08 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:15.546777 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-71116963-05c5-4b78-9259-43a8916bde08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:15.554904 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1402/2829] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:15.559021 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cd21a-b95f-41b0-a915-83f1d2e1ed28 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.569114 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cd21a-b95f-41b0-a915-83f1d2e1ed28 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.573572 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.574243 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.574532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.574817 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.575528 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:15.575861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.577498 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.588669 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1428/2830] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:15.593322 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71116963-05c5-4b78-9259-43a8916bde08 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.602578 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71116963-05c5-4b78-9259-43a8916bde08 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.607453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.608641 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.608928 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.609203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.609908 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.611854 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.704790 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1403/2831] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:56:15 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:15.708740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.719115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23d6f-2013-427e-8659-1f7383e901f7 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.775407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.776072 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.776356 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.776633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.777439 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.779409 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.920787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1429/2832] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:56:15 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:15.924936 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.935261 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce52c0-e4cb-4bd6-af69-603ca75c02e9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.939852 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.940508 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.940797 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.941078 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.941801 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.943465 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.954503 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1404/2833] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:15.958396 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.968746 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cea39-e0bc-44d4-909a-5ea7928fdd92 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.973260 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7560c9-aa21-4e74-aa37-6e2112e00013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.973898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7560c9-aa21-4e74-aa37-6e2112e00013 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.974178 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7560c9-aa21-4e74-aa37-6e2112e00013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.974487 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7560c9-aa21-4e74-aa37-6e2112e00013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.975197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7560c9-aa21-4e74-aa37-6e2112e00013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.976768 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7560c9-aa21-4e74-aa37-6e2112e00013 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.986422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1430/2834] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:15.990270 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.000248 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae01bea-f44f-452a-a284-d43f544f8134 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.004906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.005766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.006053 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.006375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] PATH_INFO: `/v3/projects/f3ba6a8bb55d4b0b809c40a1aad06fc2/users/0aee45bcd7a04a60ba8cd4dc150a11ad/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.022398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ba6a8bb55d4b0b809c40a1aad06fc2, user_id=0aee45bcd7a04a60ba8cd4dc150a11ad, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.025302 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.094901 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1405/2835] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:15 2022] PUT /identity/v3/projects/f3ba6a8bb55d4b0b809c40a1aad06fc2/users/0aee45bcd7a04a60ba8cd4dc150a11ad/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:56:16.106190 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99b991-71c4-4643-8deb-0e9464b46614 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.106509 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99b991-71c4-4643-8deb-0e9464b46614 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.106787 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99b991-71c4-4643-8deb-0e9464b46614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.132519 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-2c99b991-71c4-4643-8deb-0e9464b46614 None None] MFA Rules not processed for user `0aee45bcd7a04a60ba8cd4dc150a11ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:16.133710 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-2c99b991-71c4-4643-8deb-0e9464b46614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:16.196681 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1431/2836] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:16.201238 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.261151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eaca1-b75b-40aa-a622-e42625b3fc3c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.266374 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.267021 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.267304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.267596 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.268269 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.270161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.347653 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1406/2837] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:56:16 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:16.351673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99b991-71c4-4643-8deb-0e9464b46614 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.358283 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:16.362442 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99b991-71c4-4643-8deb-0e9464b46614 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.417095 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.417762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.418051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.418357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.419037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.420952 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.480430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1432/2838] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:56:16 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:16.481627 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.493606 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a5a97-ea6a-4af5-b53f-e2066df2d571 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.499061 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.499728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.500018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.500295 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.501019 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.502693 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.504857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:16.514136 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1407/2839] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:16.518958 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.529207 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68034c0-27e4-4766-8204-7a560bcb17d0 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.533957 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.534659 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.534938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.535214 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] PATH_INFO: `/v3/projects/998ab8878593418ab7def1ac137da643/users/8e033c852923429795e3be56e7edf0a4/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.550327 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=998ab8878593418ab7def1ac137da643, user_id=8e033c852923429795e3be56e7edf0a4, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.552948 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.654923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1433/2840] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:16 2022] PUT /identity/v3/projects/998ab8878593418ab7def1ac137da643/users/8e033c852923429795e3be56e7edf0a4/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:16.659119 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.668856 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf67fc9-3fef-4696-9225-72fac98c9e99 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.724075 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bb458-afc7-4e8b-92c0-6bc971039039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.724728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb458-afc7-4e8b-92c0-6bc971039039 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.725039 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb458-afc7-4e8b-92c0-6bc971039039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.725313 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb458-afc7-4e8b-92c0-6bc971039039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.726016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bb458-afc7-4e8b-92c0-6bc971039039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.727675 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bb458-afc7-4e8b-92c0-6bc971039039 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.738429 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1408/2841] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:16.742317 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.753358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412781-7553-4cad-8f98-a275848035aa admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.758073 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.758987 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.759274 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.759563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] PATH_INFO: `/v3/projects/998ab8878593418ab7def1ac137da643/users/8e033c852923429795e3be56e7edf0a4/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.761643 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998ab8878593418ab7def1ac137da643, user_id=8e033c852923429795e3be56e7edf0a4, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.764397 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.775310 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1434/2842] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:16 2022] PUT /identity/v3/projects/998ab8878593418ab7def1ac137da643/users/8e033c852923429795e3be56e7edf0a4/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:16.785423 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768f86d-3db0-413d-8ec7-c5a96979ffe4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.785713 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768f86d-3db0-413d-8ec7-c5a96979ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.785991 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768f86d-3db0-413d-8ec7-c5a96979ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.812400 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2768f86d-3db0-413d-8ec7-c5a96979ffe4 None None] MFA Rules not processed for user `8e033c852923429795e3be56e7edf0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:16.813598 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2768f86d-3db0-413d-8ec7-c5a96979ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:16.879885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1409/2843] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:56:16.891319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.893006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:16.952709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904ccf9-7342-4350-a65a-adbcf42a6d13 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.957268 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561ac87-32ed-4c07-ab08-7a0a024c384d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.958071 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561ac87-32ed-4c07-ab08-7a0a024c384d service cinder] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.958408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561ac87-32ed-4c07-ab08-7a0a024c384d service cinder] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.958691 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561ac87-32ed-4c07-ab08-7a0a024c384d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.977995 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561ac87-32ed-4c07-ab08-7a0a024c384d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.979629 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561ac87-32ed-4c07-ab08-7a0a024c384d service cinder] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.989975 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1435/2844] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:17.053397 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768f86d-3db0-413d-8ec7-c5a96979ffe4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:17.114780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768f86d-3db0-413d-8ec7-c5a96979ffe4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:17.119354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:17.120212 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:17.120492 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:17.120766 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] PATH_INFO: `/v3/users/0aee45bcd7a04a60ba8cd4dc150a11ad` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:17.121952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aee45bcd7a04a60ba8cd4dc150a11ad)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:17.123902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:17.144622 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:17.313130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aee45bcd7a04a60ba8cd4dc150a11ad'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:17.326009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aee45bcd7a04a60ba8cd4dc150a11ad'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:17.397516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aee45bcd7a04a60ba8cd4dc150a11ad'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:17.410952 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aee45bcd7a04a60ba8cd4dc150a11ad'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:17.411600 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aee45bcd7a04a60ba8cd4dc150a11ad'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:17.417703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1410/2845] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:56:17 2022] DELETE /identity/v3/users/0aee45bcd7a04a60ba8cd4dc150a11ad => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:17.422285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:17.422755 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:17.422885 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:17.440183 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:17.441379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:17.490801 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:17.498963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1436/2846] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:17.508787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:17.510174 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:17.567571 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cda8c-9554-4880-aded-18b887e48462 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:17.571082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:17.571724 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:17.572003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:17.572278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:17.581619 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:17.584304 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:17.592932 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1411/2847] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:17.961947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:17.963408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:17.976932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45027-69ef-49e0-97af-714642435da5 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:17.983417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:17.984285 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:17.984563 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:17.984915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] PATH_INFO: `/v3/projects/f3ba6a8bb55d4b0b809c40a1aad06fc2` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:17.986126 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ba6a8bb55d4b0b809c40a1aad06fc2)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:17.988281 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:18.145970 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ba6a8bb55d4b0b809c40a1aad06fc2', 'request_id': 'req-e88a10ce-f28a-4bef-8399-6a002cc948b1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.151702 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ba6a8bb55d4b0b809c40a1aad06fc2', 'request_id': 'req-e88a10ce-f28a-4bef-8399-6a002cc948b1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.223230 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ba6a8bb55d4b0b809c40a1aad06fc2', 'request_id': 'req-e88a10ce-f28a-4bef-8399-6a002cc948b1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.235123 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] The token cache is being invalidate because project f3ba6a8bb55d4b0b809c40a1aad06fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:56:18.235416 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.236064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.237604 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1437/2848] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:56:17 2022] DELETE /identity/v3/projects/f3ba6a8bb55d4b0b809c40a1aad06fc2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:18.241773 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:18.252009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e7e0-9535-47e2-8e71-5c223ffbfc3b service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:18.308620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:18.309493 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:18.309780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:18.310161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] PATH_INFO: `/v3/users/8e033c852923429795e3be56e7edf0a4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:18.312104 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e033c852923429795e3be56e7edf0a4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:18.314125 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:18.476861 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:18.479393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e033c852923429795e3be56e7edf0a4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.486339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e033c852923429795e3be56e7edf0a4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.583439 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e033c852923429795e3be56e7edf0a4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.596116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e033c852923429795e3be56e7edf0a4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.596802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e8442938-328c-4048-ac1e-35d2730e47c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e033c852923429795e3be56e7edf0a4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:18.602703 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1412/2849] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:56:18 2022] DELETE /identity/v3/users/8e033c852923429795e3be56e7edf0a4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:19.008900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.008900 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:19.021543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a10ce-f28a-4bef-8399-6a002cc948b1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.078661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.079524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.079806 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.080086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] PATH_INFO: `/v3/projects/998ab8878593418ab7def1ac137da643` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.081262 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998ab8878593418ab7def1ac137da643)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.083252 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.208911 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998ab8878593418ab7def1ac137da643', 'request_id': 'req-9c8592de-60c0-4b34-b99d-57c946ae7151'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:19.214648 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998ab8878593418ab7def1ac137da643', 'request_id': 'req-9c8592de-60c0-4b34-b99d-57c946ae7151'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:19.274547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998ab8878593418ab7def1ac137da643', 'request_id': 'req-9c8592de-60c0-4b34-b99d-57c946ae7151'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:19.286868 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] The token cache is being invalidate because project 998ab8878593418ab7def1ac137da643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:56:19.291478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:19.291478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9c8592de-60c0-4b34-b99d-57c946ae7151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:19.291478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1438/2850] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:56:19 2022] DELETE /identity/v3/projects/998ab8878593418ab7def1ac137da643 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:19.294531 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b8fa-641a-4d46-86fc-4c64911495b5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.294820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b8fa-641a-4d46-86fc-4c64911495b5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.295096 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b8fa-641a-4d46-86fc-4c64911495b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.313710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a9e2b8fa-641a-4d46-86fc-4c64911495b5 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:19.314921 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a9e2b8fa-641a-4d46-86fc-4c64911495b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:19.372794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1413/2851] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:19.380543 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e395d-a384-4e8e-bcec-8e2e42594f25 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.380837 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e395d-a384-4e8e-bcec-8e2e42594f25 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.381117 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e395d-a384-4e8e-bcec-8e2e42594f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.398919 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-4e9e395d-a384-4e8e-bcec-8e2e42594f25 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:19.400389 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-4e9e395d-a384-4e8e-bcec-8e2e42594f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:19.408694 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1439/2852] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:19.412780 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b8fa-641a-4d46-86fc-4c64911495b5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.422646 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b8fa-641a-4d46-86fc-4c64911495b5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.427193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.427830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.428117 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.428388 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.429089 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:19.429393 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.431016 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.442143 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1414/2853] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:56:19.446194 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e395d-a384-4e8e-bcec-8e2e42594f25 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.455375 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e395d-a384-4e8e-bcec-8e2e42594f25 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.459938 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.460575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.460858 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.461135 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.461847 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.463803 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.466968 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:19.564108 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1440/2854] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:56:19 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:19.566779 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.577206 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ad62-c936-42a4-a2ac-f4eae79ed426 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.632161 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.632822 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.633107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.633385 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.634072 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.636024 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.692311 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1415/2855] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:56:19 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:19.696365 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.706982 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0283-9f04-4c7c-a121-0323ca541825 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.711544 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.712189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.712470 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.712741 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.713457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.715063 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.725229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1441/2856] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:19.729196 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.739193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338d8c-2b47-4fd7-a9aa-7e624a49b6de admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.743947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999806f-4ef6-4df3-abda-1222d17e08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.744597 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999806f-4ef6-4df3-abda-1222d17e08d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.744885 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999806f-4ef6-4df3-abda-1222d17e08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.745166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999806f-4ef6-4df3-abda-1222d17e08d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.745882 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999806f-4ef6-4df3-abda-1222d17e08d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.747530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999806f-4ef6-4df3-abda-1222d17e08d8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.757602 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1416/2857] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:19.761678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.772385 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82398a-b5dc-4b49-a32a-ae83870b2b00 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.777229 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.778096 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.778417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.778692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] PATH_INFO: `/v3/projects/6198c41b7d0743dca0b6295ef30401c4/users/a2cceeb60ee8426b9c65558515a2d53e/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.793313 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6198c41b7d0743dca0b6295ef30401c4, user_id=a2cceeb60ee8426b9c65558515a2d53e, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.796001 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.894069 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1442/2858] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:19 2022] PUT /identity/v3/projects/6198c41b7d0743dca0b6295ef30401c4/users/a2cceeb60ee8426b9c65558515a2d53e/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:56:19.962308 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189d145-563a-4626-aa2d-deed06682562 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.962589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189d145-563a-4626-aa2d-deed06682562 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.962877 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189d145-563a-4626-aa2d-deed06682562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.998159 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d189d145-563a-4626-aa2d-deed06682562 None None] MFA Rules not processed for user `a2cceeb60ee8426b9c65558515a2d53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:19.999977 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d189d145-563a-4626-aa2d-deed06682562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:20.012375 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:20.062825 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1417/2859] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:20.067247 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:20.128146 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a232b0-c09c-4129-a77a-4697e0b0d4c1 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:20.132760 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:20.133408 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.133692 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.133966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.134675 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:20.136566 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:20.223947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1443/2860] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:56:20 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:20.227819 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189d145-563a-4626-aa2d-deed06682562 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:20.238299 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189d145-563a-4626-aa2d-deed06682562 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:20.294710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:20.295923 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.296203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.296507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.297175 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:20.299193 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:20.395454 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1418/2861] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:56:20 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:20.399429 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:20.409780 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69119c-2fc1-422e-84a3-1e26a7cee1bb admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:20.414445 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:20.415092 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.415371 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.415646 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.416357 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:20.417977 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:20.429050 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1444/2862] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:20.432947 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:20.443473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855777-f048-4761-8f75-c541efd0a6b5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:20.448074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:20.448946 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.449233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.449514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] PATH_INFO: `/v3/projects/639cb87b54ac4830a1f777d12ccab71d/users/b27e93fea52847e89bcd361def3279ac/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.464003 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=639cb87b54ac4830a1f777d12ccab71d, user_id=b27e93fea52847e89bcd361def3279ac, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:20.466698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:20.531838 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1419/2863] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:20 2022] PUT /identity/v3/projects/639cb87b54ac4830a1f777d12ccab71d/users/b27e93fea52847e89bcd361def3279ac/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:20.535844 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:20.546112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0665-cff2-466e-8605-96bd3f5cd794 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:20.600497 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaf631-51a8-4567-9713-63d6beeb8d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:20.601161 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaf631-51a8-4567-9713-63d6beeb8d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.601457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaf631-51a8-4567-9713-63d6beeb8d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.601750 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaf631-51a8-4567-9713-63d6beeb8d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.602495 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaf631-51a8-4567-9713-63d6beeb8d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:20.604086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaf631-51a8-4567-9713-63d6beeb8d49 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:20.614112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1445/2864] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:20.618519 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:20.629205 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c9d2-00d2-49b4-b36a-20421998b15a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:20.633813 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:20.634725 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.635015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.635297 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] PATH_INFO: `/v3/projects/639cb87b54ac4830a1f777d12ccab71d/users/b27e93fea52847e89bcd361def3279ac/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.637249 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639cb87b54ac4830a1f777d12ccab71d, user_id=b27e93fea52847e89bcd361def3279ac, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:20.640022 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:20.650292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1420/2865] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:20 2022] PUT /identity/v3/projects/639cb87b54ac4830a1f777d12ccab71d/users/b27e93fea52847e89bcd361def3279ac/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:20.660173 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32c3f-9a09-4da9-912c-913d15dfc55b None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.660468 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32c3f-9a09-4da9-912c-913d15dfc55b None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.660753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32c3f-9a09-4da9-912c-913d15dfc55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.687158 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-24c32c3f-9a09-4da9-912c-913d15dfc55b None None] MFA Rules not processed for user `b27e93fea52847e89bcd361def3279ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:20.688352 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-24c32c3f-9a09-4da9-912c-913d15dfc55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:20.696304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:20.755748 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1446/2866] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:20.767980 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:20.769659 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:20.827441 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006af530-8eb5-4351-9145-6fafbe9a4d26 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:20.831251 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:20.831900 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:20.832188 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:20.832462 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:20.842726 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:20.844166 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:20.853710 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1421/2867] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:21.776740 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32c3f-9a09-4da9-912c-913d15dfc55b None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:21.786395 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32c3f-9a09-4da9-912c-913d15dfc55b None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:21.791047 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b27e93fea52847e89bcd361def3279ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639cb87b54ac4830a1f777d12ccab71d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:21.791701 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:21.791992 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:21.792280 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:21.793006 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:21.793321 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:21.794961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:21.806951 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1447/2868] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:21.811058 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:21.820176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2089c7-3437-47a9-b32f-d16c577c3a04 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:21.824899 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b27e93fea52847e89bcd361def3279ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639cb87b54ac4830a1f777d12ccab71d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:21.825552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:21.825846 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:21.826130 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:21.827365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:21.829305 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:21.837253 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:21.911434 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1422/2869] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:56:21 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:56:21.915532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:21.928815 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96135eca-d5c0-4ab4-9560-273f4556e674 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:21.984661 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b27e93fea52847e89bcd361def3279ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639cb87b54ac4830a1f777d12ccab71d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:21.985414 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:21.985703 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:21.985985 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:21.986770 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:21.987088 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:21.988738 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:21.999971 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1448/2870] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:22.035934 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:22.045972 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4aefb-8be0-4c7b-8b7b-79823ddfa549 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:22.050530 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b27e93fea52847e89bcd361def3279ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639cb87b54ac4830a1f777d12ccab71d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:22.051387 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:22.051676 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:22.051965 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] PATH_INFO: `/v3/projects/858ea301aef7407196658606a2b62817` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:22.053138 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorizing `identity:delete_project(project_id=858ea301aef7407196658606a2b62817)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:22.055107 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:22.158544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858ea301aef7407196658606a2b62817', 'request_id': 'req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:22.164055 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858ea301aef7407196658606a2b62817', 'request_id': 'req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:22.254656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858ea301aef7407196658606a2b62817', 'request_id': 'req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:22.266411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] The token cache is being invalidate because project 858ea301aef7407196658606a2b62817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:56:22.266697 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:22.267329 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e0ff7d47-fbf3-41b0-b3a1-3a19f1d590f1 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:22.268867 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1423/2871] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:56:22 2022] DELETE /identity/v3/projects/858ea301aef7407196658606a2b62817 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:22.937115 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:22.938907 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:23.002432 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99fc67-33c3-4cf0-b44b-5e8982fc9f93 tempest-VolumeQuotaClassesTest-244069587 tempest-VolumeQuotaClassesTest-244069587-project-admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:23.031369 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=100 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:23.070457 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:23.071329 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:23.071678 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:23.071895 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] PATH_INFO: `/v3/users/a2cceeb60ee8426b9c65558515a2d53e` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:23.073290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cceeb60ee8426b9c65558515a2d53e)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:23.075290 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:23.233711 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cceeb60ee8426b9c65558515a2d53e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:23.240620 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cceeb60ee8426b9c65558515a2d53e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:23.241276 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cceeb60ee8426b9c65558515a2d53e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:23.242014 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cceeb60ee8426b9c65558515a2d53e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:23.305808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cceeb60ee8426b9c65558515a2d53e'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:23.323537 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1449/2872] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:56:22 2022] DELETE /identity/v3/users/a2cceeb60ee8426b9c65558515a2d53e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:23.328532 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:23.329035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:23.329134 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:23.347082 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:23.350583 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:23.415111 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1424/2873] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:23.424680 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:23.426074 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:23.482105 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131775-42db-48af-b4a9-adfc3d504abb admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:23.485915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:23.486587 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:23.486873 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:23.487150 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:23.496093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:23.497532 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:23.506947 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1450/2874] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:23.961398 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:23.963009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:23.984123 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e040fa-0a35-4c7d-be8c-6616b8c679ca None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:23.989171 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:23.989926 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:23.990278 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:23.990489 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] PATH_INFO: `/v3/projects/6198c41b7d0743dca0b6295ef30401c4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:23.991656 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6198c41b7d0743dca0b6295ef30401c4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:23.993543 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:24.131718 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6198c41b7d0743dca0b6295ef30401c4', 'request_id': 'req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.137233 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6198c41b7d0743dca0b6295ef30401c4', 'request_id': 'req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.205561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6198c41b7d0743dca0b6295ef30401c4', 'request_id': 'req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.207456 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:24.216670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] The token cache is being invalidate because project 6198c41b7d0743dca0b6295ef30401c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:56:24.216956 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.217576 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.219250 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1425/2875] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:56:23 2022] DELETE /identity/v3/projects/6198c41b7d0743dca0b6295ef30401c4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:24.223289 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:24.232784 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8d919-e7de-4a4e-831b-ba995bd39962 service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:24.284223 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:24.290903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:24.291795 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:24.292221 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:24.292507 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] PATH_INFO: `/v3/users/b27e93fea52847e89bcd361def3279ac` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:24.293700 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27e93fea52847e89bcd361def3279ac)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:24.296171 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:24.461777 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27e93fea52847e89bcd361def3279ac'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.469512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27e93fea52847e89bcd361def3279ac'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.470175 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27e93fea52847e89bcd361def3279ac'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.470889 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27e93fea52847e89bcd361def3279ac'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.543083 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-bf224229-56ef-466b-bba7-f3bd596ef401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27e93fea52847e89bcd361def3279ac'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:24.561157 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1451/2876] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:56:24 2022] DELETE /identity/v3/users/b27e93fea52847e89bcd361def3279ac => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:24.964629 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:24.966025 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:24.979561 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5ec6a-d2ee-49cb-8508-fb7f817af8ac admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.038093 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.038902 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.039187 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.039467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] PATH_INFO: `/v3/projects/639cb87b54ac4830a1f777d12ccab71d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.040640 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=639cb87b54ac4830a1f777d12ccab71d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.042594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.192521 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639cb87b54ac4830a1f777d12ccab71d', 'request_id': 'req-52a6642b-0618-4db8-a14a-ad15c448da2a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:25.197982 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639cb87b54ac4830a1f777d12ccab71d', 'request_id': 'req-52a6642b-0618-4db8-a14a-ad15c448da2a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:25.323279 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639cb87b54ac4830a1f777d12ccab71d', 'request_id': 'req-52a6642b-0618-4db8-a14a-ad15c448da2a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:25.335562 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] The token cache is being invalidate because project 639cb87b54ac4830a1f777d12ccab71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:56:25.335857 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:25.336483 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-52a6642b-0618-4db8-a14a-ad15c448da2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:56:25.338018 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1426/2877] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:56:24 2022] DELETE /identity/v3/projects/639cb87b54ac4830a1f777d12ccab71d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:25.343057 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a796b4d-e600-4e5d-b991-64a261dbde68 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.343545 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a796b4d-e600-4e5d-b991-64a261dbde68 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.343645 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a796b4d-e600-4e5d-b991-64a261dbde68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.370910 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0a796b4d-e600-4e5d-b991-64a261dbde68 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:25.372116 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0a796b4d-e600-4e5d-b991-64a261dbde68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:25.430417 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1452/2878] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:25.438820 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233405bf-ce4d-4c07-a9b7-5f0e3ae65187 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.447000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233405bf-ce4d-4c07-a9b7-5f0e3ae65187 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.447000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233405bf-ce4d-4c07-a9b7-5f0e3ae65187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.458151 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-233405bf-ce4d-4c07-a9b7-5f0e3ae65187 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:25.459411 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-233405bf-ce4d-4c07-a9b7-5f0e3ae65187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:25.468245 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1427/2879] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:25.472471 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a796b4d-e600-4e5d-b991-64a261dbde68 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.482102 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a796b4d-e600-4e5d-b991-64a261dbde68 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.486698 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.487430 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.487718 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.487994 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] PATH_INFO: `/v3/domains` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.488709 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:25.489012 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.490670 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.502611 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1453/2880] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 19 21:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:25.506998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233405bf-ce4d-4c07-a9b7-5f0e3ae65187 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.516830 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233405bf-ce4d-4c07-a9b7-5f0e3ae65187 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.521516 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.522202 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.522513 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.522794 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.523480 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.525634 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.628544 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1428/2881] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:56:25 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:25.632923 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.642930 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1132f-f27b-4906-ad33-3bcb1b7d976f admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.689197 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:25.697625 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.698318 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.698603 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.698880 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.699553 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.701466 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.800898 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1454/2882] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:56:25 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:25.805067 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.815746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60f7aa-70e0-423a-9478-5083d838bf80 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.820318 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.820961 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.821243 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.821517 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.822324 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.823916 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.834087 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1429/2883] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:25.837879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.847490 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab7cea-5dd9-41fa-9cad-8781e65fbfb4 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.851963 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e108f-2a39-4097-84c1-073c4486acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.852601 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e108f-2a39-4097-84c1-073c4486acf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.852881 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e108f-2a39-4097-84c1-073c4486acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.853156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e108f-2a39-4097-84c1-073c4486acf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.853861 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e108f-2a39-4097-84c1-073c4486acf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.855454 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e108f-2a39-4097-84c1-073c4486acf5 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.866535 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1455/2884] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:25.870127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.880552 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59d3af-0a96-4ce5-8df5-c14b873666ab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.885035 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.885896 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.886179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.886554 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] PATH_INFO: `/v3/projects/1108f9bccbfb4988bb9a791f2db37f62/users/d497b8c2aeea416eb0eba9137bbf3ed1/roles/2e1a7d8a55ac4d66b5464eafdab93afb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.901007 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1108f9bccbfb4988bb9a791f2db37f62, user_id=d497b8c2aeea416eb0eba9137bbf3ed1, role_id=2e1a7d8a55ac4d66b5464eafdab93afb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.903698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:26.003260 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1430/2885] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:25 2022] PUT /identity/v3/projects/1108f9bccbfb4988bb9a791f2db37f62/users/d497b8c2aeea416eb0eba9137bbf3ed1/roles/2e1a7d8a55ac4d66b5464eafdab93afb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:26.008422 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6689f-0c05-47d0-99a7-f026d1de9846 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:26.008717 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6689f-0c05-47d0-99a7-f026d1de9846 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:26.009008 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6689f-0c05-47d0-99a7-f026d1de9846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:26.026204 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-1df6689f-0c05-47d0-99a7-f026d1de9846 None None] MFA Rules not processed for user `21d9725cafcc4283be987ee60ded1556`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:26.027441 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-1df6689f-0c05-47d0-99a7-f026d1de9846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:26.085142 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1456/2886] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:26.095306 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:26.097009 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:26.123183 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:26.154341 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2918-f4c3-41a9-8ab3-2a60c09f820f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:26.158514 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:26.159180 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:26.159467 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:26.159746 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:26.169033 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:26.171057 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:26.180476 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1431/2887] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:27.373458 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3184c-c682-4af8-8aea-e0eae1cb6308 None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.373937 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3184c-c682-4af8-8aea-e0eae1cb6308 None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.374319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3184c-c682-4af8-8aea-e0eae1cb6308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.400808 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-0cb3184c-c682-4af8-8aea-e0eae1cb6308 None None] MFA Rules not processed for user `d497b8c2aeea416eb0eba9137bbf3ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:27.402043 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-0cb3184c-c682-4af8-8aea-e0eae1cb6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:27.468189 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1457/2888] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:27.472802 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:27.482617 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c692899-cb5f-481f-9d2a-dd72aa14bff1 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:27.487146 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:27.487781 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.488068 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.488347 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.489044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:27.491020 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:27.601859 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1432/2889] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 19 21:56:27 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:27.603315 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3184c-c682-4af8-8aea-e0eae1cb6308 None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:27.614724 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3184c-c682-4af8-8aea-e0eae1cb6308 None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:27.671512 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:27.672239 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.672524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.672804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] PATH_INFO: `/v3/users` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.673508 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:27.675461 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:27.682915 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:27.798538 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1458/2890] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 19 21:56:27 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:27.802670 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:27.813403 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc55971-230f-4698-bb30-ddc47110bb78 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:27.817865 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:27.818553 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.818834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.819108 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.819826 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:27.821392 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:27.831913 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1433/2891] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:56:27.835865 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:27.845804 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf124-d6ae-4c39-9d95-2e281cb1ad04 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:27.850455 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:27.851316 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.851600 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.851932 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] PATH_INFO: `/v3/projects/161927409a3b449dbcd2394800f6fab3/users/b722f1069e644d95b05b35f505e16892/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.866753 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161927409a3b449dbcd2394800f6fab3, user_id=b722f1069e644d95b05b35f505e16892, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:27.869399 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:27.941037 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1459/2892] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:27 2022] PUT /identity/v3/projects/161927409a3b449dbcd2394800f6fab3/users/b722f1069e644d95b05b35f505e16892/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:27.945179 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:27.955217 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6933c3-073a-4095-869e-4b7be2e3fc91 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:28.020974 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3e1c1-c9dc-4288-ba9b-bde98cb0b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:28.021648 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3e1c1-c9dc-4288-ba9b-bde98cb0b93d admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:28.021937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3e1c1-c9dc-4288-ba9b-bde98cb0b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:28.022240 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3e1c1-c9dc-4288-ba9b-bde98cb0b93d admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:28.022971 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3e1c1-c9dc-4288-ba9b-bde98cb0b93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:28.024879 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3e1c1-c9dc-4288-ba9b-bde98cb0b93d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:28.035203 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1434/2893] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 19 21:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:28.039405 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:28.049969 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9b7e-bda0-440b-b1b4-57c466495af8 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:28.054478 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e4b4e-cf26-469e-a92d-36a014837813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:28.055345 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e4b4e-cf26-469e-a92d-36a014837813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:28.055628 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e4b4e-cf26-469e-a92d-36a014837813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:28.055901 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e4b4e-cf26-469e-a92d-36a014837813 admin admin] PATH_INFO: `/v3/projects/161927409a3b449dbcd2394800f6fab3/users/b722f1069e644d95b05b35f505e16892/roles/11cd7e23a6344d30b5af1fc2f1967ab3` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:28.057839 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e4b4e-cf26-469e-a92d-36a014837813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161927409a3b449dbcd2394800f6fab3, user_id=b722f1069e644d95b05b35f505e16892, role_id=11cd7e23a6344d30b5af1fc2f1967ab3)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:28.060483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e4b4e-cf26-469e-a92d-36a014837813 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:28.071112 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1460/2894] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 19 21:56:28 2022] PUT /identity/v3/projects/161927409a3b449dbcd2394800f6fab3/users/b722f1069e644d95b05b35f505e16892/roles/11cd7e23a6344d30b5af1fc2f1967ab3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:29.203930 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:29.204407 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:29.204507 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:29.231473 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] MFA Rules not processed for user `b722f1069e644d95b05b35f505e16892`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:29.232691 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:29.313267 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1435/2895] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:29.324609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] REQUEST_METHOD: `POST` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:29.325168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:29.325168 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:29.342201 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.auth.core [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] MFA Rules not processed for user `d497b8c2aeea416eb0eba9137bbf3ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=80350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:29.343407 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:29.396831 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1461/2896] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 19 21:56:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:56:29.409770 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:29.414382 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:29.425887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:29.484158 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197481-b7d2-49f1-b128-89bccee1dcce None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:29.489623 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:29.490300 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:29.490589 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:29.490895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:29.498811 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:29.501052 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:29.510316 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1436/2897] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:29.733324 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:29.735355 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:29.790863 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787955e0-d29a-4af6-b8a1-82c685fe1eac None None] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:29.794411 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b920b115454a708a14a62ead99eccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:29.795051 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:29.795333 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:29.795609 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:29.797984 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:29.809928 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:29.811366 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:29.820524 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1462/2898] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:30.224683 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:30.226095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:30.305079 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec078a7-46f0-44e3-8fb6-80c6e3069b19 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:30.310116 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:30.310785 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:30.311074 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:30.311354 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:30.313728 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:30.324937 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:30.326610 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:30.336834 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1437/2899] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:39.816109 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:INSERT=4,keystone:SELECT=68 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:40.332453 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=60 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:40.433655 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:40.435174 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:40.459186 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df82056-58d0-41ff-aa8f-14de9859097e service neutron] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:40.464615 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37df82be35a448bf819e4f157741b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:40.465256 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:40.465573 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:40.465851 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:40.467621 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:40.480391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:40.482086 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:40.493599 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1463/2900] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:56:45.257895 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:45.259365 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:45.321765 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db55cc-092e-4c85-a31b-4fa76524abda service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:45.325369 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65573e15809c42a98cc3e603355df832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:45.326015 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:45.326339 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:45.326620 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:45.335558 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:45.336994 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:45.346915 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1438/2901] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:56:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:56:50.488792 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=9 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:55.342176 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=26 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:07.690811 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:07.692170 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:07.706966 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d93fa-a065-48bb-b5ff-6bde7ddcb926 service nova] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:07.712030 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:07.712673 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:07.712961 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:07.713265 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:07.715113 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:07.727848 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:07.729435 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:07.739779 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1464/2902] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:57:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:08.271996 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:08.288918 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416f14d-0aec-45bd-826b-a9fd60187a36 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:08.294095 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:08.294845 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:08.295129 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:08.295438 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:08.297280 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:08.314000 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:08.316127 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:08.327661 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1439/2903] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:57:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:08.379922 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:08.441776 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cda65-cdcb-472f-a619-dd464f96b756 service placement] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:08.446879 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:08.447743 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:08.448028 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:08.448304 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] PATH_INFO: `/v3/users/d497b8c2aeea416eb0eba9137bbf3ed1` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:08.449462 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d497b8c2aeea416eb0eba9137bbf3ed1)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:08.451391 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:08.612955 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd497b8c2aeea416eb0eba9137bbf3ed1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:08.620483 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd497b8c2aeea416eb0eba9137bbf3ed1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:08.621156 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd497b8c2aeea416eb0eba9137bbf3ed1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:08.621769 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd497b8c2aeea416eb0eba9137bbf3ed1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:08.690651 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd497b8c2aeea416eb0eba9137bbf3ed1'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:08.708081 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1465/2904] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:57:08 2022] DELETE /identity/v3/users/d497b8c2aeea416eb0eba9137bbf3ed1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:57:08.952048 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:08.963044 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c9c87-495a-4678-8cfe-d5d27b6418d0 service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:09.024228 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:09.025132 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:09.025427 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:09.025687 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] PATH_INFO: `/v3/projects/1108f9bccbfb4988bb9a791f2db37f62` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:09.026887 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1108f9bccbfb4988bb9a791f2db37f62)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:09.028787 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:09.133189 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1108f9bccbfb4988bb9a791f2db37f62', 'request_id': 'req-e9501355-6062-4338-b0d5-fe1aba594de9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.138594 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1108f9bccbfb4988bb9a791f2db37f62', 'request_id': 'req-e9501355-6062-4338-b0d5-fe1aba594de9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.211170 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1108f9bccbfb4988bb9a791f2db37f62', 'request_id': 'req-e9501355-6062-4338-b0d5-fe1aba594de9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.222371 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] The token cache is being invalidate because project 1108f9bccbfb4988bb9a791f2db37f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:57:09.222663 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.223292 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.224906 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1440/2905] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:57:08 2022] DELETE /identity/v3/projects/1108f9bccbfb4988bb9a791f2db37f62 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:57:09.228981 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:09.230633 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:09.243575 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ef7e-f559-4bc1-b4a9-9b48fe7b453c admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:09.299379 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:09.300261 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:09.300547 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:09.300826 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] PATH_INFO: `/v3/users/b722f1069e644d95b05b35f505e16892` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:09.302045 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b722f1069e644d95b05b35f505e16892)` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:09.304093 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:09.315829 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:09.503830 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b722f1069e644d95b05b35f505e16892'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.511762 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b722f1069e644d95b05b35f505e16892'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.512429 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b722f1069e644d95b05b35f505e16892'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.513064 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b722f1069e644d95b05b35f505e16892'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.607374 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.notifications [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b722f1069e644d95b05b35f505e16892'} {{(pid=80350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:09.625903 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1466/2906] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 19 21:57:09 2022] DELETE /identity/v3/users/b722f1069e644d95b05b35f505e16892 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:57:09.889940 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:09.891448 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:09.904301 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9501355-6062-4338-b0d5-fe1aba594de9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:09.972285 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d9725cafcc4283be987ee60ded1556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3385220604fe5b83ffe6c82f91b54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:09.973145 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:09.973426 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:09.973698 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] PATH_INFO: `/v3/projects/161927409a3b449dbcd2394800f6fab3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:09.975391 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=161927409a3b449dbcd2394800f6fab3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:09.977264 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:09.998326 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:10.087590 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161927409a3b449dbcd2394800f6fab3', 'request_id': 'req-e002b393-dae6-471e-8257-68ac889c0da5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:10.092945 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161927409a3b449dbcd2394800f6fab3', 'request_id': 'req-e002b393-dae6-471e-8257-68ac889c0da5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:10.150323 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161927409a3b449dbcd2394800f6fab3', 'request_id': 'req-e002b393-dae6-471e-8257-68ac889c0da5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:10.162029 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] The token cache is being invalidate because project 161927409a3b449dbcd2394800f6fab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 21:57:10.162848 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:10.163469 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e002b393-dae6-471e-8257-68ac889c0da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 21:57:10.164998 dv-cinder-835635-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1441/2907] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 19 21:57:09 2022] DELETE /identity/v3/projects/161927409a3b449dbcd2394800f6fab3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:57:19.621602 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:20.159685 dv-cinder-835635-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:31.843864 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Authenticating user token {{(pid=80350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:31.845358 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:31.933766 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437b917-3d89-4aec-980f-a306ea72e2c3 admin admin] Validating token access rules against request {{(pid=80350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:31.991079 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7791ae6-38db-4f09-98e3-15cf95ae3d7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c36dedeee54c2c84db268a76d4b37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66bb396a7a0144a78064b22c09912555', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:31.991736 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791ae6-38db-4f09-98e3-15cf95ae3d7c service placement] REQUEST_METHOD: `GET` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:31.992022 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791ae6-38db-4f09-98e3-15cf95ae3d7c service placement] SCRIPT_NAME: `/identity` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:31.992299 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791ae6-38db-4f09-98e3-15cf95ae3d7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:31.994638 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.fernet_utils [None req-c7791ae6-38db-4f09-98e3-15cf95ae3d7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:32.005716 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791ae6-38db-4f09-98e3-15cf95ae3d7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:32.007319 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791ae6-38db-4f09-98e3-15cf95ae3d7c service placement] RBAC: Authorization granted {{(pid=80350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:32.017248 dv-cinder-835635-2-smb devstack@keystone.service[80350]: [pid: 80350|app: 0|req: 1467/2908] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 19 21:57:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:42.013009 dv-cinder-835635-2-smb devstack@keystone.service[80350]: DEBUG dbcounter [-] [80350] Writing DB stats keystone:SELECT=67 {{(pid=80350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}